00000001:02000400:2.0F:1788329850.152969:0:3301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788329874.869045:0:3523:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1788329877.699895:0:3584:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 447 MB/s 00000001:01000000:2.0:1788329877.949474:0:3584:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 663 MB/s 00000001:01000000:2.0:1788329878.199364:0:3584:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4231 MB/s 00000020:02000000:3.0F:1788329879.286511:0:3614:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_104_g6cc0f2c 00000400:02000000:0.0:1788329880.659701:0:3630:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.150@tcp [8/256/0/180] 00008000:02000000:2.0:1788329886.025904:0:3779:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788329959.027913:0:5749:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788329973.428990:0:6499:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788329973.428999:0:6499:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788329973.429000:0:6499:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788329973.429200:0:6499:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000027cb53c5 00000080:02000400:2.0:1788329973.429213:0:6499:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788329973.442142:0:6499:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788329973.442433:0:6499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788329973.442484:0:6499:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000029030d19) 00000020:00000080:2.0:1788329973.442516:0:6499:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788329973.589119:0:6499:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788329973.589263:0:6499:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1788329973.625073:0:6499:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788329973.625981:0:6499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788329973.625990:0:6499:0:(osd_handler.c:8927:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788329973.626002:0:6499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd09aa 00000020:01000004:1.0:1788329973.626010:0:6499:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788329973.626014:0:6499:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788329973.626019:0:6499:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000027cb53c5 from MGS 00000020:01000004:1.0:1788329973.626024:0:6499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788329973.626046:0:6499:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000044e7665a) 00000020:00000080:1.0:1788329973.626060:0:6499:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788329973.626246:0:6499:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000027cb53c5 from MGS, refs=2 00080000:01000000:1.0:1788329973.626252:0:6499:0:(osd_handler.c:8927:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788329973.626257:0:6499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd09b8 00000100:00100000:1.0:1788329973.626637:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788329973.626959:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788329973.626966:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788329973.627868:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788329973.627884:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788329973.630872:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788329973.631461:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788329973.631484:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788329973.632599:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788329973.632611:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788329973.633229:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788329973.633237:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788329973.634525:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329973.634530:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329973.634533:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329973.636114:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329973.636120:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329973.636122:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329973.637055:0:6499:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788329973.649368:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1788329973.886252:0:6499:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2711 MB/s 00000001:01000000:0.0:1788329974.136238:0:6499:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3035 MB/s 00000001:01000000:1.0:1788329974.388619:0:6499:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 440 MB/s 00000001:01000000:1.0:1788329974.641606:0:6499:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 565 MB/s 00080000:10000000:3.0:1788329974.656922:0:6499:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1788329974.682014:0:6499:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788329974.690790:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788329974.691641:0:6499:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788329974.691729:0:6499:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788329974.691970:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788329974.691999:0:6499:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00010000:00010000:0.0:1788329974.695484:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788329974.695706:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788329974.695924:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788329974.695931:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788329974.697474:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788329974.697487:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788329974.700015:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788329974.700030:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788329974.701762:0:6499:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788329974.701788:0:6499:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.150@tcp' 00000020:01000004:2.0:1788329974.701790:0:6499:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788329974.701841:0:6499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.150@tcp (typ=mgc) 00000020:00000080:2.0:1788329974.701855:0:6499:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.150@tcp (0000000070b0b7c0) 00000020:00000080:2.0:1788329974.701876:0:6499:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788329974.701984:0:6499:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000fc251b91@MGC192.168.202.150@tcp: add connection 192.168.202.150@tcp at head 00010000:00010000:2.0:1788329974.702222:0:6499:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.150@tcp-0 is initialized 00000040:01000000:2.0:1788329974.702229:0:6499:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788329974.702616:0:6519:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788329974.702650:0:6499:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.150@tcp (uuid cfe8163f-ff22-4eb0-b728-b3e96f32c3cf) 00000020:00000080:0.0:1788329974.702666:0:6499:0:(genops.c:1385:class_connect()) connect: client cfe8163f-ff22-4eb0-b728-b3e96f32c3cf, cookie 0x8475908e9fd09c6 00000100:00080000:0.0:1788329974.702676:0:6499:0:(import.c:510:import_select_connection()) MGC192.168.202.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788329974.702680:0:6499:0:(import.c:624:import_select_connection()) MGC192.168.202.150@tcp: import 00000000fc251b91 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:0.0:1788329974.702729:0:6499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000ddb7e45 x1875199792251008/t0(0) o250->MGC192.168.202.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788329974.702750:0:6499:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cfe8163f-ff22-4eb0-b728-b3e96f32c3cf->MGS 00000020:01000004:0.0:1788329974.702769:0:6499:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788329974.702774:0:6499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788329974.702793:0:6499:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000073bb7ec2) 00000020:00000080:0.0:1788329974.702803:0:6499:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:1.0:1788329974.706899:0:6518:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1788329974.707042:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ddb7e45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3645:1875199792251008:0@lo:250: 00000100:00100000:1.0:1788329974.707138:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329974.724281:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792251008 00000100:00100000:2.0:1788329974.724304:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792251008 00000100:00100000:2.0:1788329974.724348:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788329974.724356:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfa7ab0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3645:x1875199792251008:12345-0@lo:250: 00010000:00080000:2.0:1788329974.724386:0:6515:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from cfe8163f-ff22-4eb0-b728-b3e96f32c3cf@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:2.0:1788329974.724430:0:6515:0:(genops.c:1385:class_connect()) connect: client cfe8163f-ff22-4eb0-b728-b3e96f32c3cf, cookie 0x8475908e9fd09d4 00000100:00080000:2.0:1788329974.724891:0:6515:0:(import.c:65:import_set_state_nolock()) 0000000071ec85c6 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788329974.725001:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfa7ab0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+5:3645:x1875199792251008:12345-0@lo:250: Request processed in 644us (17863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329974.725011:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788329974.725187:0:3645:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788329974.725196:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.150@tcp: connect to target with instance 0 00000100:00080000:2.0:1788329974.725204:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788329974.725209:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788329974.725212:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000fc251b91 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788329974.725214:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788329974.725224:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788329974.725229:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ddb7e45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3645:1875199792251008:0@lo:250: 00000100:00100000:0.0:1788329974.743651:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788329974.743924:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788329974.743931:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788329974.754489:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788329974.754506:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788329974.755817:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788329974.755830:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788329974.757005:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788329974.758030:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788329974.758040:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788329974.760628:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788329974.760655:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788329974.872402:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788329974.873867:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788329974.873878:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788329974.878870:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788329974.878887:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788329974.879993:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788329974.880273:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788329974.880280:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788329974.881396:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788329974.881406:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788329974.882338:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788329974.882563:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788329974.882569:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788329974.888195:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788329974.888210:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788329974.889527:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788329974.889978:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788329974.889985:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788329974.891085:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788329974.891095:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788329974.934936:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788329974.935357:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788329974.935374:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788329974.937574:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788329974.937592:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788329974.942042:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788329974.942062:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788329974.943458:0:6499:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788329974.943584:0:6499:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788329974.943593:0:6499:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788329974.943921:0:6499:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788329974.943963:0:6499:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.150@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788329974.943968:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788329974.943969:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788329974.943971:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788329974.943976:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788329974.943977:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788329974.943978:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788329974.943979:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788329974.943980:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788329974.943982:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788329974.943983:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788329974.943985:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788329974.943986:0:6499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788329974.943989:0:6499:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788329974.943992:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788329974.943993:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788329974.943994:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788329974.943994:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788329974.943995:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788329974.943996:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788329974.943997:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788329974.943998:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788329974.943998:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788329974.943999:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788329974.944000:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788329974.944001:0:6499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788329974.944039:0:6499:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788329974.944058:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc65ef7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792251136:0@lo:253: 00000100:00100000:2.0:1788329974.944132:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329974.944285:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a44aebec going to sleep for 11 seconds 00000100:00100000:0.0:1788329974.944440:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792251136 00000100:00100000:0.0:1788329974.944449:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792251136 00000100:00100000:0.0:1788329974.944536:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788329974.944547:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d308cd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+5:6499:x1875199792251136:12345-0@lo:253: 20000000:01000000:0.0:1788329974.944593:0:6517:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788329974.944596:0:6517:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788329974.945114:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788329974.945328:0:6517:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788329974.945825:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788329974.946988:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788329974.947463:0:6517:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788329974.947468:0:6517:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788329974.947474:0:6517:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788329974.947477:0:6517:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788329974.947492:0:6517:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788329974.947905:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788329974.948083:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788329974.948099:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788329974.948117:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788329974.948133:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788329974.948146:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788329974.948536:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788329974.948546:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788329974.948561:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788329974.948567:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788329974.948579:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788329974.948584:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788329974.948596:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788329974.948611:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788329974.948826:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788329974.948833:0:6517:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788329974.948841:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788329974.948986:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788329974.948997:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788329974.949013:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788329974.949039:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788329974.949052:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788329974.949060:0:6517:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788329974.949085:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788329974.949093:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788329974.949106:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788329974.949138:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788329974.949311:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788329974.949323:0:6517:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788329974.949349:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788329974.949358:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788329974.949371:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788329974.949387:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788329974.949462:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788329974.949487:0:6517:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788329974.949496:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788329974.950035:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788329974.951965:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788329974.952005:0:6517:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.150@tcp for mdt 20000000:01000000:0.0:1788329974.952008:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.150@tcp (null) (null) (null) 00000040:00080000:0.0:1788329974.952026:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788329974.952033:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788329974.952046:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788329974.952052:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.150@tcp (null) (null) 00000040:00080000:0.0:1788329974.952063:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788329974.952070:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788329974.952082:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788329974.952096:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788329974.952125:0:6517:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788329974.952127:0:6517:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788329974.952131:0:6517:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788329974.954434:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788329974.954457:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788329974.955287:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788329974.955560:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788329974.955595:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788329974.955613:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1788329974.955622:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788329974.955624:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788329974.956554:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788329974.956915:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788329974.956943:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788329974.956985:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788329974.957000:0:6517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788329974.957002:0:6517:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788329974.957009:0:6517:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788329974.957011:0:6517:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788329974.957017:0:6517:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788329974.957024:0:6517:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788329974.957446:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788329974.957574:0:6517:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788329974.967823:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788329974.967878:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788329974.967896:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788329974.967918:0:6517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788329974.967946:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b68dd659/0x8475908e9fd09db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329974.967967:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b68dd659/0x8475908e9fd09db lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329974.967977:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b68dd659/0x8475908e9fd09db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329974.967984:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b68dd659/0x8475908e9fd09db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329974.968013:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b68dd659/0x8475908e9fd09db lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329974.968021:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b68dd659/0x8475908e9fd09db lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329974.968027:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b68dd659 already unused, calling callback (000000002f5b363c) 00010000:00010000:0.0:1788329974.968031:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b68dd659/0x8475908e9fd09db lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329974.968039:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b68dd659/0x8475908e9fd09db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329974.968052:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b68dd659/0x8475908e9fd09db lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329974.968059:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b68dd659/0x8475908e9fd09db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329974.968065:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b68dd659/0x8475908e9fd09db lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788329974.968092:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788329974.982435:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d308cd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+5:6499:x1875199792251136:12345-0@lo:253: Request processed in 37877us (38289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329974.982471:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788329974.982843:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc65ef7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792251136:0@lo:253: 10000000:01000000:2.0:1788329974.982862:0:6499:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788329974.982866:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788329974.982868:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788329974.982869:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788329974.982871:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788329974.982872:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788329974.982874:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788329974.982892:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788329974.982893:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788329974.982895:0:6499:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788329974.982896:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788329974.982897:0:6499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788329974.982919:0:6499:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000027cb53c5 from lustre-MDT0000 10000000:01000000:2.0:1788329974.982950:0:6499:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788329974.982953:0:6499:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788329974.982958:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99eee7570000 10000000:01000000:2.0:1788329974.982962:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788329974.982971:0:6499:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99eee7570000 from 1 10000000:01000000:2.0:1788329974.982974:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788329974.983015:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 00000000d149c57f/0x8475908e9fd09e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329974.983027:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 00000000d149c57f/0x8475908e9fd09e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329974.983038:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 00000000d149c57f/0x8475908e9fd09e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329974.983057:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc65ef7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792251264:0@lo:101: 00000100:00100000:2.0:1788329974.983100:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329974.983360:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd875539 going to sleep for 11 seconds 00000100:00100000:3.0:1788329974.983463:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792251264 00000100:00100000:3.0:1788329974.983471:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792251264 00000100:00100000:3.0:1788329974.983914:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788329974.983926:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000308334e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+5:6499:x1875199792251264:12345-0@lo:101: 00010000:00010000:3.0:1788329974.983940:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788329974.983955:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000b1f3a29/0x8475908e9fd09e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd09e2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329974.983982:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000b1f3a29/0x8475908e9fd09e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd09e2 expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329974.983993:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000b1f3a29/0x8475908e9fd09e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd09e2 expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329974.984003:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000b1f3a29, rc 0) 00000100:00100000:3.0:1788329974.984080:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000308334e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+6:6499:x1875199792251264:12345-0@lo:101: Request processed in 158us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329974.984087:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788329974.984204:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc65ef7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792251264:0@lo:101: 00010000:00010000:0.0:1788329974.984220:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 00000000d149c57f/0x8475908e9fd09e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd09e9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329974.984229:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 00000000d149c57f/0x8475908e9fd09e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd09e9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329974.984314:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792251392:0@lo:501: 00000100:00100000:0.0:1788329974.984346:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329974.984912:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 000000006dda0013 going to sleep for 11 seconds 00000100:00100000:2.0:1788329974.984979:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792251392 00000100:00100000:2.0:1788329974.984986:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792251392 00000100:00100000:2.0:1788329974.985018:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788329974.985025:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ac842d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+6:6499:x1875199792251392:12345-0@lo:501: 00000100:00100000:2.0:1788329974.985126:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ac842d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+6:6499:x1875199792251392:12345-0@lo:501: Request processed in 101us (780us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788329974.985134:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788329974.985238:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792251392:0@lo:501: 10000000:01000000:0.0:1788329974.985273:0:6499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788329974.985294:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 00000000d149c57f/0x8475908e9fd09e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd09e9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329974.985303:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 00000000d149c57f/0x8475908e9fd09e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd09e9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788329974.985313:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99eec865b000 10000000:01000000:0.0:1788329974.985318:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788329974.985323:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99eec865b000 10000000:01000000:0.0:1788329974.985326:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788329974.985328:0:6499:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99eec865b000 from 1 10000000:01000000:0.0:1788329974.985331:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788329974.985357:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 00000000b68dd659/0x8475908e9fd09f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329974.985364:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 00000000b68dd659/0x8475908e9fd09f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329974.985372:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 00000000b68dd659/0x8475908e9fd09f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329974.985387:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792251520:0@lo:101: 00000100:00100000:0.0:1788329974.985464:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329974.985486:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 000000006dda0013 going to sleep for 11 seconds 00000100:00100000:2.0:1788329974.985841:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792251520 00000100:00100000:2.0:1788329974.985853:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792251520 00000100:00100000:2.0:1788329974.985877:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788329974.985883:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cef3af40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+6:6499:x1875199792251520:12345-0@lo:101: 00010000:00010000:2.0:1788329974.985893:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788329974.985907:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bfdaf92e/0x8475908e9fd09f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd09f0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329974.985923:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bfdaf92e/0x8475908e9fd09f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd09f0 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329974.985931:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bfdaf92e/0x8475908e9fd09f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd09f0 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329974.985940:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bfdaf92e, rc 0) 00000100:00100000:2.0:1788329974.985983:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cef3af40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+7:6499:x1875199792251520:12345-0@lo:101: Request processed in 100us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329974.985989:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788329974.986065:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792251520:0@lo:101: 00010000:00010000:0.0:1788329974.986077:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 00000000b68dd659/0x8475908e9fd09f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd09f7 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329974.986085:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 00000000b68dd659/0x8475908e9fd09f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd09f7 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788329974.986097:0:6499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788329974.986113:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 00000000b68dd659/0x8475908e9fd09f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd09f7 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329974.986119:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 00000000b68dd659/0x8475908e9fd09f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd09f7 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788329974.986127:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788329974.986131:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788329974.986136:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99eec865b000 10000000:01000000:0.0:1788329974.986139:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788329974.986142:0:6499:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788329974.986143:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788329974.986184:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd09fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329974.986192:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd09fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329974.986198:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd09fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329974.986218:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792251648:0@lo:101: 00000100:00100000:0.0:1788329974.986246:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329974.986260:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 000000006dda0013 going to sleep for 11 seconds 00000100:00100000:2.0:1788329974.986345:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792251648 00000100:00100000:2.0:1788329974.986350:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792251648 00000100:00100000:2.0:1788329974.986370:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788329974.986376:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000964dedac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+7:6499:x1875199792251648:12345-0@lo:101: 00010000:00010000:2.0:1788329974.986383:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788329974.986390:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001ae44c4e/0x8475908e9fd0a05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd09fe expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329974.986402:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001ae44c4e/0x8475908e9fd0a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd09fe expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329974.986421:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001ae44c4e/0x8475908e9fd0a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd09fe expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329974.986438:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001ae44c4e, rc 0) 00000100:00100000:2.0:1788329974.986475:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000964dedac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+8:6499:x1875199792251648:12345-0@lo:101: Request processed in 99us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329974.986482:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788329974.986554:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792251648:0@lo:101: 00010000:00010000:0.0:1788329974.986564:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd09fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0a05 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329974.986572:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd09fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0a05 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329974.986623:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792251776:0@lo:501: 00000100:00100000:0.0:1788329974.986667:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329974.986697:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 000000006dda0013 going to sleep for 11 seconds 00000100:00100000:2.0:1788329974.986979:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792251776 00000100:00100000:2.0:1788329974.986984:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792251776 00000100:00100000:2.0:1788329974.987005:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788329974.987010:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050794590 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+8:6499:x1875199792251776:12345-0@lo:501: 00000100:00100000:2.0:1788329974.987134:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050794590 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+9:6499:x1875199792251776:12345-0@lo:501: Request processed in 124us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329974.987141:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788329974.987305:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792251776:0@lo:501: 00000100:00100000:0.0:1788329974.987334:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792251904:0@lo:503: 00000100:00100000:0.0:1788329974.987377:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329974.987405:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 000000006dda0013 going to sleep for 11 seconds 00000100:00100000:2.0:1788329974.987466:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792251904 00000100:00100000:2.0:1788329974.987471:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792251904 00000100:00100000:2.0:1788329974.987489:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788329974.987494:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098d25708 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+9:6499:x1875199792251904:12345-0@lo:503: 00000100:00100000:2.0:1788329974.987593:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098d25708 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+9:6499:x1875199792251904:12345-0@lo:503: Request processed in 99us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329974.987601:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788329974.987955:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792251904:0@lo:503: 00000100:00100000:0.0:1788329974.988366:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6544:1875199792252032:0@lo:502: 00000100:00100000:0.0:1788329974.988418:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329974.988459:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set 0000000013174fd8 going to sleep for 11 seconds 00000100:00100000:2.0:1788329974.988612:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792252032 00000100:00100000:2.0:1788329974.988619:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792252032 00000100:00100000:2.0:1788329974.988825:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788329974.988833:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031cc9c6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+9:6544:x1875199792252032:12345-0@lo:502: 00000100:00100000:2.0:1788329974.988943:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031cc9c6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+9:6544:x1875199792252032:12345-0@lo:502: Request processed in 111us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329974.988951:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788329974.989039:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6544:1875199792252032:0@lo:502: 00000020:01000000:0.0:1788329974.989061:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788329974.989072:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788329974.989080:0:6544:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788329974.989085:0:6544:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788329974.989089:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788329974.989106:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000002bbbc275) 00000020:00000080:0.0:1788329974.989127:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788329974.989133:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788329974.989251:0:6544:0:(osd_handler.c:8927:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788329974.989259:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd0a13 00000020:00000080:0.0:1788329974.990098:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788329974.990106:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788329974.990111:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788329974.990112:0:6544:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788329974.990115:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788329974.990120:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788329974.990121:0:6544:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788329974.990125:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788329974.990136:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000ebde8188) 00000020:00000080:0.0:1788329974.990308:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788329974.990316:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788329974.990318:0:6544:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788329974.990321:0:6544:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788329974.990328:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788329974.990403:0:6544:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000027cb53c5 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788329974.990441:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000001d0b9ae2) 00000020:00000080:0.0:1788329974.990591:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788329974.990855:0:6544:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788329974.990863:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd0a28 00000020:00000080:0.0:1788329974.990995:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788329974.991001:0:6544:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788329974.991006:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8475908e9fd0a2f 00080000:01000000:0.0:1788329974.991012:0:6544:0:(osd_handler.c:8927:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788329974.991016:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd0a36 00080000:10000000:0.0:1788329974.991733:0:6544:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1788329974.991891:0:6544:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788329975.000023:0:6544:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788329975.098847:0:6544:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788329975.099759:0:6544:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788329975.107455:0:6544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788329975.108505:0:6544:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788329975.112984:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000dccb2a7f) 00000020:00000080:3.0:1788329975.113015:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788329975.113362:0:6544:0:(osd_handler.c:8927:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788329975.113594:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd0a44 00000020:00000080:3.0:1788329975.118903:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788329975.121304:0:6544:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1788329975.136935:0:6544:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1788329975.145072:0:6544:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1788329975.149595:0:6544:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1788329975.152923:0:6544:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1788329975.156695:0:6544:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1788329975.160531:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8475908e9fd0a4b 00000020:00000080:3.0:1788329975.160921:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788329975.160934:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788329975.160940:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329975.160942:0:6544:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788329975.160945:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788329975.160949:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329975.160950:0:6544:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788329975.160953:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788329975.160955:0:6544:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788329975.160958:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788329975.160960:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329975.160962:0:6544:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788329975.160964:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788329975.160969:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329975.160970:0:6544:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788329975.160981:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788329975.161023:0:6544:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788329975.161673:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099691eb6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6544:1875199792252160:0@lo:502: 00000100:00100000:2.0:1788329975.161775:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329975.161881:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c3da1773 going to sleep for 11 seconds 00000100:00100000:0.0:1788329975.161940:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792252160 00000100:00100000:0.0:1788329975.161949:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792252160 00000100:00100000:0.0:1788329975.162051:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788329975.162061:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae1bc43c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+9:6544:x1875199792252160:12345-0@lo:502: 00000100:00100000:0.0:1788329975.162236:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae1bc43c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+9:6544:x1875199792252160:12345-0@lo:502: Request processed in 177us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329975.162244:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788329975.162353:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099691eb6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6544:1875199792252160:0@lo:502: 00000020:01000000:2.0:1788329975.162395:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788329975.162402:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788329975.162404:0:6544:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788329975.162417:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788329975.162725:0:6499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788329975.162748:0:6499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788329975.162769:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd09fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0a05 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329975.162779:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd09fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0a05 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329975.162788:0:6499:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99eec865b000 from 1 10000000:01000000:3.0:1788329975.162791:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788329975.162840:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 00000000363e7cb7/0x8475908e9fd0a52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329975.162850:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 00000000363e7cb7/0x8475908e9fd0a52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329975.162858:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 00000000363e7cb7/0x8475908e9fd0a52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329975.162873:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1b37e0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792252288:0@lo:101: 00000100:00100000:3.0:1788329975.162912:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329975.163831:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792252288 00000100:00100000:1.0:1788329975.163841:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792252288 00000100:00100000:1.0:1788329975.163879:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788329975.163887:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d92c8ebf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+9:6499:x1875199792252288:12345-0@lo:101: 00010000:00010000:1.0:1788329975.163902:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788329975.163920:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000031eaaaa3/0x8475908e9fd0a59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0a52 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329975.163956:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000031eaaaa3/0x8475908e9fd0a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0a52 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329975.163966:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000031eaaaa3/0x8475908e9fd0a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0a52 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329975.163975:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000031eaaaa3, rc 0) 00000100:00100000:1.0:1788329975.164016:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d92c8ebf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+10:6499:x1875199792252288:12345-0@lo:101: Request processed in 130us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329975.164022:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788329975.164628:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 0000000035f8bd10 going to sleep for 11 seconds 00000100:00100000:3.0:1788329975.164658:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1b37e0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792252288:0@lo:101: 00010000:00010000:3.0:1788329975.164680:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 00000000363e7cb7/0x8475908e9fd0a52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0a59 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329975.164690:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 00000000363e7cb7/0x8475908e9fd0a52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0a59 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329975.165314:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1b37e0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792252416:0@lo:256: 00000100:00100000:3.0:1788329975.165672:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329975.165710:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 0000000035f8bd10 going to sleep for 11 seconds 00000100:00100000:1.0:1788329975.165805:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792252416 00000100:00100000:1.0:1788329975.165813:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792252416 00000100:00100000:1.0:1788329975.165850:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788329975.165858:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092d6740a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+10:6499:x1875199792252416:12345-0@lo:256: 20000000:01000000:1.0:1788329975.165877:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788329975.165884:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788329975.165965:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092d6740a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+10:6499:x1875199792252416:12345-0@lo:256: Request processed in 107us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329975.165972:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788329975.166738:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1b37e0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792252416:0@lo:256: 10000000:01000000:3.0:1788329975.167730:0:6499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788329975.167871:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 00000000363e7cb7/0x8475908e9fd0a52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0a59 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329975.167885:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 00000000363e7cb7/0x8475908e9fd0a52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0a59 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329975.167894:0:6499:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eec865b000 from 1 10000000:01000000:3.0:1788329975.167897:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788329975.167939:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 000000007184cbbb/0x8475908e9fd0a60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329975.167948:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 000000007184cbbb/0x8475908e9fd0a60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329975.167958:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 000000007184cbbb/0x8475908e9fd0a60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329975.167980:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1b37e0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792252544:0@lo:101: 00000100:00100000:3.0:1788329975.168054:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329975.168097:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 0000000035f8bd10 going to sleep for 11 seconds 00000100:00100000:0.0:1788329975.168483:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792252544 00000100:00100000:0.0:1788329975.168562:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792252544 00000100:00100000:0.0:1788329975.168618:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788329975.168627:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000774ac26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+10:6499:x1875199792252544:12345-0@lo:101: 00010000:00010000:0.0:1788329975.168642:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788329975.168657:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000024aa7369/0x8475908e9fd0a67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0a60 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.168680:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000024aa7369/0x8475908e9fd0a67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0a60 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.168690:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000024aa7369/0x8475908e9fd0a67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0a60 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.168699:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000024aa7369, rc 0) 00000100:00100000:0.0:1788329975.168822:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000774ac26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+11:6499:x1875199792252544:12345-0@lo:101: Request processed in 195us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329975.168829:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788329975.169088:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1b37e0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792252544:0@lo:101: 00010000:00010000:3.0:1788329975.169106:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 000000007184cbbb/0x8475908e9fd0a60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0a67 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329975.170826:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 000000007184cbbb/0x8475908e9fd0a60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0a67 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329975.170930:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1b37e0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792252672:0@lo:501: 00000100:00100000:3.0:1788329975.170998:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329975.171266:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 0000000035f8bd10 going to sleep for 11 seconds 00000100:00100000:2.0:1788329975.177998:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792252672 00000100:00100000:2.0:1788329975.178019:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792252672 00000100:00100000:2.0:1788329975.178089:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788329975.178099:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3a6070c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+11:6499:x1875199792252672:12345-0@lo:501: 00000100:00100000:3.0:1788329975.179637:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3a6070c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+11:6499:x1875199792252672:12345-0@lo:501: Request processed in 1532us (8632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329975.179650:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788329975.179921:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1b37e0a pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792252672:0@lo:501: 00000100:00100000:2.0:1788329975.179978:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099691eb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792252800:0@lo:503: 00000100:00100000:2.0:1788329975.180230:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329975.180325:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f8e61e84 going to sleep for 11 seconds 00000100:00100000:0.0:1788329975.180563:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792252800 00000100:00100000:0.0:1788329975.180571:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792252800 00000100:00100000:0.0:1788329975.180666:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788329975.180687:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000762034e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+11:6499:x1875199792252800:12345-0@lo:503: 00000040:00080000:0.0:1788329975.180833:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788329975.180936:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000762034e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+11:6499:x1875199792252800:12345-0@lo:503: Request processed in 251us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329975.180944:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788329975.181019:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099691eb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792252800:0@lo:503: 00000040:00080000:0.0:1788329975.183909:0:6548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788329975.184828:0:6499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788329975.184864:0:6499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788329975.184885:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 000000007184cbbb/0x8475908e9fd0a60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0a67 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329975.184900:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 000000007184cbbb/0x8475908e9fd0a60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0a67 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788329975.185020:0:6499:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788329975.185024:0:6499:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99eec865b000 10000000:01000000:0.0:1788329975.185027:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99eec865b000 10000000:01000000:0.0:1788329975.185042:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788329975.185050:0:6499:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99eec865b000 from 1 10000000:01000000:0.0:1788329975.185053:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788329975.185091:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 00000000d1d178d0/0x8475908e9fd0a6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.185100:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 00000000d1d178d0/0x8475908e9fd0a6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.185111:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 00000000d1d178d0/0x8475908e9fd0a6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329975.185136:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792252928:0@lo:101: 00000100:00100000:0.0:1788329975.185308:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329975.185357:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 00000000905008dd going to sleep for 11 seconds 00000100:00100000:2.0:1788329975.185757:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792252928 00000100:00100000:2.0:1788329975.185767:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792252928 00000100:00100000:2.0:1788329975.185818:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788329975.185836:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080ca53d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+11:6499:x1875199792252928:12345-0@lo:101: 00010000:00010000:2.0:1788329975.185851:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788329975.185862:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000054480581/0x8475908e9fd0a75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0a6e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329975.185885:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000054480581/0x8475908e9fd0a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0a6e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329975.185896:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000054480581/0x8475908e9fd0a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0a6e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329975.185906:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000054480581, rc 0) 00000100:00100000:2.0:1788329975.185950:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080ca53d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:6499:x1875199792252928:12345-0@lo:101: Request processed in 116us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329975.185957:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788329975.186265:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792252928:0@lo:101: 00010000:00010000:0.0:1788329975.186282:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 00000000d1d178d0/0x8475908e9fd0a6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0a75 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.186290:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 00000000d1d178d0/0x8475908e9fd0a6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0a75 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329975.186364:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792253056:0@lo:501: 00000100:00100000:0.0:1788329975.186588:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329975.186619:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 00000000905008dd going to sleep for 11 seconds 00000100:00100000:1.0:1788329975.186694:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792253056 00000100:00100000:1.0:1788329975.186700:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792253056 00000100:00100000:1.0:1788329975.186736:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788329975.186744:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000829fdcd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:6499:x1875199792253056:12345-0@lo:501: 00000100:00100000:1.0:1788329975.186867:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000829fdcd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:6499:x1875199792253056:12345-0@lo:501: Request processed in 124us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329975.186875:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788329975.186987:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792253056:0@lo:501: 00000100:00100000:0.0:1788329975.187014:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792253184:0@lo:503: 00000100:00100000:0.0:1788329975.187072:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329975.187129:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 00000000905008dd going to sleep for 11 seconds 00000100:00100000:2.0:1788329975.188121:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792253184 00000100:00100000:2.0:1788329975.188130:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792253184 00000100:00100000:3.0:1788329975.188375:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788329975.188384:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9175bc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:6499:x1875199792253184:12345-0@lo:503: 00000100:00100000:3.0:1788329975.188538:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9175bc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:6499:x1875199792253184:12345-0@lo:503: Request processed in 155us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329975.188545:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788329975.188638:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792253184:0@lo:503: 00000100:00100000:0.0:1788329975.189187:0:6549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6549:1875199792253312:0@lo:502: 00000100:00100000:0.0:1788329975.189244:0:6549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329975.189655:0:6549:0:(client.c:2715:ptlrpc_set_wait()) set 000000006dda0013 going to sleep for 11 seconds 00000100:00100000:1.0:1788329975.189727:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792253312 00000100:00100000:1.0:1788329975.189746:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792253312 00000100:00100000:1.0:1788329975.189778:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788329975.189784:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000820c30f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:6549:x1875199792253312:12345-0@lo:502: 00000100:00100000:1.0:1788329975.189912:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000820c30f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:6549:x1875199792253312:12345-0@lo:502: Request processed in 127us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329975.189920:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788329975.190010:0:6549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6549:1875199792253312:0@lo:502: 00000020:01000004:0.0:1788329975.190084:0:6549:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788329975.190112:0:6549:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006d99ca63) 00000020:00000080:0.0:1788329975.190134:0:6549:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788329975.190273:0:6549:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000027cb53c5 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788329975.190278:0:6549:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000027cb53c5 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788329975.190280:0:6549:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000027cb53c5 4 00010000:00080000:0.0:1788329975.190307:0:6549:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000dee3ee95@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.150@tcp at head 00010000:00010000:0.0:1788329975.191959:0:6549:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788329975.192254:0:6549:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788329975.192300:0:6549:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788329975.192313:0:6549:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8475908e9fd0a83 00000100:00080000:0.0:1788329975.192323:0:6549:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788329975.192328:0:6549:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000dee3ee95 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:0.0:1788329975.192381:0:6549:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cee08ebe x1875199792253440/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788329975.192422:0:6549:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788329975.193115:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875199792253440:0@lo:38: 00000100:00100000:2.0:1788329975.193357:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329975.194401:0:6549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027a917f0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6549:1875199792253568:0@lo:502: 00000100:00100000:1.0:1788329975.194482:0:6549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329975.194529:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792253568 00000100:00100000:1.0:1788329975.194539:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792253568 00000100:00100000:1.0:1788329975.194593:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788329975.194602:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014bc1146 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:6549:x1875199792253568:12345-0@lo:502: 00000100:00100000:1.0:1788329975.194727:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014bc1146 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:6549:x1875199792253568:12345-0@lo:502: Request processed in 125us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329975.194736:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788329975.194780:0:6549:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c7fac91b going to sleep for 11 seconds 00000100:00100000:1.0:1788329975.194803:0:6549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027a917f0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6549:1875199792253568:0@lo:502: 00000040:00080000:1.0:1788329975.194834:0:6549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:0.0:1788329975.196191:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792253440 00000100:00100000:0.0:1788329975.196204:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792253440 00000100:00100000:0.0:1788329975.196244:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788329975.196250:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099691eb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875199792253440:12345-0@lo:38: 00000020:01000000:2.0:1788329975.198269:0:6499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788329975.198316:0:6499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788329975.198338:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 00000000d1d178d0/0x8475908e9fd0a6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0a75 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329975.198351:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 00000000d1d178d0/0x8475908e9fd0a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0a75 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788329975.198436:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788329975.198439:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788329975.198444:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788329975.198446:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788329975.198447:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788329975.198448:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788329975.198450:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788329975.198451:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788329975.198452:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788329975.198453:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788329975.198454:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788329975.198456:0:6499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788329975.198459:0:6499:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788329975.198461:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788329975.198463:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788329975.198464:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788329975.198465:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788329975.198465:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788329975.198466:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788329975.198467:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788329975.198468:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788329975.198469:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788329975.198469:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788329975.198470:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788329975.198471:0:6499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788329975.198501:0:6499:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788329975.198518:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002238fb0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792253696:0@lo:253: 00000100:00100000:2.0:1788329975.198590:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329975.198634:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 00000000000bad0a going to sleep for 11 seconds 00000100:00100000:0.0:1788329975.198731:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099691eb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875199792253440:12345-0@lo:38: Request processed in 2478us (5372us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788329975.198743:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788329975.199180:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792253696 00000100:00100000:1.0:1788329975.199191:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792253696 00000100:00100000:1.0:1788329975.199261:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788329975.199272:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045e4abfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:6499:x1875199792253696:12345-0@lo:253: 20000000:01000000:1.0:1788329975.199307:0:6517:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788329975.199324:0:6517:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788329975.202842:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788329975.202856:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000dee3ee95 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788329975.202864:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788329975.202868:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cee08ebe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875199792253440:0@lo:38: 20000000:01000000:3.0:1788329975.210995:0:6517:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788329975.211065:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788329975.212826:0:6538:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788329975.212835:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788329975.212862:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005e913acf/0x8475908e9fd0a8a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329975.212884:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000031eaaaa3/0x8475908e9fd0a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0a52 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329975.212893:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005e913acf/0x8475908e9fd0a8a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329975.212963:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000031eaaaa3/0x8475908e9fd0a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0a52 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329975.212979:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000031eaaaa3/0x8475908e9fd0a59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0a52 expref: 12 pid: 6517 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329975.212994:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000080fb8f9c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875199792253824:0@lo:104: 00000100:00100000:2.0:1788329975.213139:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329975.213433:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a44aebec going to sleep for 11 seconds 00000100:00100000:2.0:1788329975.213826:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045e4abfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:6499:x1875199792253696:12345-0@lo:253: Request processed in 14554us (15234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329975.213837:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788329975.213940:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002238fb0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6499:1875199792253696:0@lo:253: 10000000:01000000:3.0:1788329975.213955:0:6499:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788329975.213958:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788329975.213960:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788329975.213962:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788329975.213963:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788329975.213972:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788329975.213974:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788329975.213975:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788329975.213977:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788329975.213978:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788329975.213979:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788329975.213981:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788329975.213983:0:6499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788329975.213997:0:6499:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788329975.218679:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792253824 00000100:00100000:1.0:1788329975.218700:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792253824 00000100:00100000:1.0:1788329975.218779:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788329975.218790:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016d1691a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:6538:x1875199792253824:12345-0@lo:104: 00010000:00010000:1.0:1788329975.218827:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: 00000000363e7cb7/0x8475908e9fd0a52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0a59 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329975.219705:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788329975.219716:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016d1691a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:6538:x1875199792253824:12345-0@lo:104: Request processed in 927us (6576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329975.219727:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788329975.219862:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788329975.219869:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: 00000000363e7cb7/0x8475908e9fd0a52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0a59 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.219878:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000363e7cb7 already unused, calling callback (0000000099c7d1d5) 10000000:00010000:0.0:1788329975.219882:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: 00000000363e7cb7/0x8475908e9fd0a52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0a59 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.219890:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: 00000000363e7cb7/0x8475908e9fd0a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0a59 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788329975.219897:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: 00000000363e7cb7/0x8475908e9fd0a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0a59 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788329975.219923:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788329975.219975:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: 00000000363e7cb7/0x8475908e9fd0a52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0a59 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.219983:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788329975.220013:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: 00000000363e7cb7/0x8475908e9fd0a52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0a59 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.220042:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: 00000000363e7cb7/0x8475908e9fd0a52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0a59 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.220061:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329975.220063:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329975.220064:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788329975.221590:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788329975.221615:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e6d461c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792253952:0@lo:103: 00000100:00100000:3.0:1788329975.221697:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329975.222628:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792253952 00000100:00100000:0.0:1788329975.222639:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792253952 00010000:00010000:0.0:1788329975.222675:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000031eaaaa3/0x8475908e9fd0a59 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0a52 expref: 12 pid: 6517 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329975.222717:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788329975.222726:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000740558c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:3646:x1875199792253952:12345-0@lo:103: 00010000:00010000:0.0:1788329975.222739:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788329975.222743:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000031eaaaa3/0x8475908e9fd0a59 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0a52 expref: 12 pid: 6517 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.222754:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000031eaaaa3/0x8475908e9fd0a59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0a52 expref: 12 pid: 6517 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.222775:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005e913acf/0x8475908e9fd0a8a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.222783:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005e913acf/0x8475908e9fd0a8a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788329975.222800:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009965961s 00010000:00010000:0.0:1788329975.222804:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005e913acf/0x8475908e9fd0a8a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.222824:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005e913acf/0x8475908e9fd0a8a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.222830:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005e913acf/0x8475908e9fd0a8a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.222835:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005e913acf/0x8475908e9fd0a8a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.222841:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005e913acf already unused, calling callback (000000002f5b363c) 00010000:00010000:0.0:1788329975.222845:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005e913acf/0x8475908e9fd0a8a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.222852:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005e913acf/0x8475908e9fd0a8a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.222862:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005e913acf/0x8475908e9fd0a8a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329975.222873:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788329975.222935:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000740558c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:3646:x1875199792253952:12345-0@lo:103: Request processed in 209us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329975.222943:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788329975.222991:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e6d461c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792253952:0@lo:103: 00010000:00010000:2.0:1788329975.228641:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000031eaaaa3/0x8475908e9fd0a59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0a52 expref: 11 pid: 6517 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329975.228670:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000080fb8f9c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875199792253824:0@lo:104: 00010000:00010000:2.0:1788329975.228697:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005e913acf/0x8475908e9fd0a8a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329975.228730:0:6538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005e913acf/0x8475908e9fd0a8a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329975.228737:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005e913acf/0x8475908e9fd0a8a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329975.228742:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005e913acf/0x8475908e9fd0a8a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788329975.230398:0:6499:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1788329975.230792:0:6499:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788329975.231042:0:6499:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1788329975.231226:0:6499:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788329975.231425:0:6499:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1788329975.232747:0:6499:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788329975.234733:0:6499:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1788329975.234933:0:6499:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788329975.235922:0:6499:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1788329975.237342:0:6499:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788329975.237790:0:6499:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1788329975.238958:0:6499:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1788329975.242983:0:6499:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788329975.261642:0:6499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788329975.261891:0:6554:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788329975.261896:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788329975.262181:0:6555:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788329975.265279:0:6499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788329975.265431:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788329975.265945:0:6499:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788329975.265954:0:6499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788329975.266087:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788329975.267728:0:6499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788329975.270371:0:6555:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788329975.271937:0:6499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788329975.272014:0:6499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788329975.272292:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788329975.274832:0:6499:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1788329975.276949:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788329975.277134:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000040:00080000:0.0:1788329975.278293:0:6555:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788329975.278380:0:6555:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788329975.278385:0:6555:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1788329975.278754:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788329975.278975:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788329975.279897:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788329975.280056:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788329975.280795:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788329975.280949:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788329975.281085:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788329975.281270:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788329975.281461:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788329975.281963:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788329975.282597:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788329975.282781:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788329975.282954:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788329975.283100:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788329975.284698:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788329975.284881:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788329975.285021:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788329975.285229:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788329975.285420:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788329975.285988:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788329975.286125:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788329975.286643:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788329975.286784:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788329975.286937:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788329975.287073:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788329975.287701:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788329975.287859:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788329975.288012:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788329975.288637:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788329975.289055:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788329975.289438:0:6499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788329975.293745:0:6499:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788329975.293789:0:6499:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb7bcc1a87988 00100000:10000000:2.0:1788329975.293815:0:6499:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788329975.295322:0:6499:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788329975.295347:0:6499:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.150@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788329975.295366:0:6499:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788329975.295396:0:6499:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788329975.299933:0:6499:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788329975.300250:0:6499:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788329975.708743:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329976.736469:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329977.758246:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329978.782499:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329979.808640:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788329980.320221:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000080fb8f9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792254080:0@lo:400: 00000100:00100000:3.0:1788329980.320312:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329980.320449:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792254080 00000100:00100000:0.0:1788329980.320460:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792254080 00000100:00100000:0.0:1788329980.320526:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788329980.320535:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000846481dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+11:3648:x1875199792254080:12345-0@lo:400: 00000100:00080000:2.0:1788329980.320615:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788329980.320621:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788329980.320625:0:36:0:(import.c:65:import_set_state_nolock()) 00000000dee3ee95 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788329980.320633:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000dee3ee95 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788329980.320658:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ef374b69 x1875199792254208/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788329980.320738:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef374b69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875199792254208:0@lo:38: 00000100:00100000:2.0:1788329980.320771:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329980.320817:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792254208 00000100:00100000:2.0:1788329980.320820:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792254208 00000100:00100000:2.0:1788329980.320843:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788329980.320848:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e01a992a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875199792254208:12345-0@lo:38: 00010000:00080000:2.0:1788329980.320871:0:6524:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:2.0:1788329980.320913:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8475908e9fd0a91 00000004:00100000:2.0:1788329980.320963:0:6524:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788329980.321106:0:6524:0:(import.c:65:import_set_state_nolock()) 00000000a2b85a69 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788329980.321145:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e01a992a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875199792254208:12345-0@lo:38: Request processed in 296us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329980.321175:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788329980.321217:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ef374b69 x1875199792254208/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788329990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788329980.321233:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788329980.321241:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788329980.321245:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788329980.321248:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000dee3ee95 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788329980.321265:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef374b69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875199792254208:0@lo:38: 00000100:00100000:0.0:1788329980.329108:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000846481dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+11:3648:x1875199792254080:12345-0@lo:400: Request processed in 8560us (8782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329980.329132:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788329980.329954:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000080fb8f9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792254080:0@lo:400: 00010000:00010000:0.0:1788329980.827623:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788329980.925622:0:6800:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788329981.861318:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788329982.006924:0:6852:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788329982.007285:0:6852:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788329982.877115:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788329982.878835:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788329982.878845:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99eec865b000 from 3 10000000:01000000:1.0:1788329982.878852:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788329982.878913:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 00000000c6c89403/0x8475908e9fd0a98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329982.878928:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 00000000c6c89403/0x8475908e9fd0a98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329982.878939:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 00000000c6c89403/0x8475908e9fd0a98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329982.878968:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027a917f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792254336:0@lo:101: 00000100:00100000:1.0:1788329982.879042:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329982.879114:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1ede50a going to sleep for 11 seconds 00000100:00100000:3.0:1788329982.883863:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792254336 00000100:00100000:3.0:1788329982.883883:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792254336 00000100:00100000:3.0:1788329982.883960:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788329982.883970:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9772fc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+11:6519:x1875199792254336:12345-0@lo:101: 00010000:00010000:3.0:1788329982.883991:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788329982.884019:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000363e7cb7/0x8475908e9fd0a9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0a98 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329982.884046:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000363e7cb7/0x8475908e9fd0a9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0a98 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329982.884059:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000363e7cb7/0x8475908e9fd0a9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0a98 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329982.884068:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000363e7cb7, rc 0) 00000100:00100000:3.0:1788329982.884179:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9772fc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:6519:x1875199792254336:12345-0@lo:101: Request processed in 210us (5135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329982.884188:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788329982.884220:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027a917f0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792254336:0@lo:101: 00010000:00010000:2.0:1788329982.884248:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 00000000c6c89403/0x8475908e9fd0a98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0a9f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329982.884259:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 00000000c6c89403/0x8475908e9fd0a98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0a9f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329982.884774:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084564d5e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792254464:0@lo:256: 00000100:00100000:3.0:1788329982.884819:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329982.884864:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 00000000108eab78 going to sleep for 11 seconds 00000100:00100000:2.0:1788329982.884868:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792254464 00000100:00100000:2.0:1788329982.884876:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792254464 00000100:00100000:3.0:1788329982.885407:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788329982.885418:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f72a94d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:6519:x1875199792254464:12345-0@lo:256: 20000000:01000000:3.0:1788329982.885435:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788329982.885451:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788329982.885454:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788329982.885565:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f72a94d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:6519:x1875199792254464:12345-0@lo:256: Request processed in 140us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329982.885573:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788329982.885587:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084564d5e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792254464:0@lo:256: 10000000:01000000:2.0:1788329982.885654:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788329982.885670:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 00000000c6c89403/0x8475908e9fd0a98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0a9f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329982.885678:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 00000000c6c89403/0x8475908e9fd0a98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0a9f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329983.899456:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329984.926351:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788329985.211400:0:6953:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788329985.211607:0:6953:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788329985.441002:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788329985.441030:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef374b69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792254592:0@lo:400: 00000100:00100000:2.0:1788329985.441118:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329985.441450:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788329985.441460:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000635cd8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792254720:0@lo:400: 00000100:00100000:0.0:1788329985.441499:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329985.447615:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792254592 00000100:00100000:3.0:1788329985.447636:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792254592 00000100:00100000:3.0:1788329985.447714:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788329985.447725:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043a6fbbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:3648:x1875199792254592:12345-0@lo:400: 00000100:00100000:3.0:1788329985.447834:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043a6fbbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:3648:x1875199792254592:12345-0@lo:400: Request processed in 111us (6716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329985.447841:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788329985.448845:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792254720 00000100:00100000:1.0:1788329985.448856:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792254720 00000100:00100000:1.0:1788329985.448909:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788329985.448917:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6d461c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792254720:12345-0@lo:400: 00000100:00100000:1.0:1788329985.449003:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6d461c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792254720:12345-0@lo:400: Request processed in 87us (7504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329985.449010:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788329985.454763:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef374b69 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792254592:0@lo:400: 00010000:00080000:0.0:1788329985.455040:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000635cd8d x1875199792254720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329985.455054:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000635cd8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792254720:0@lo:400: 00010000:00010000:3.0:1788329985.949215:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329986.974285:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329987.995453:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329989.020261:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329990.047794:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788329990.555377:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788329990.555403:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d25af5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792254848:0@lo:400: 00000100:00100000:1.0:1788329990.555479:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329990.555538:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6efe686 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792254976:0@lo:400: 00000100:00100000:1.0:1788329990.555571:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329990.555610:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792254848 00000100:00100000:1.0:1788329990.555618:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792254848 00000100:00100000:1.0:1788329990.555664:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788329990.555672:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010a67bac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:3646:x1875199792254848:12345-0@lo:400: 00000100:00100000:1.0:1788329990.555720:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010a67bac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:3646:x1875199792254848:12345-0@lo:400: Request processed in 49us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329990.555728:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788329990.555759:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792254976 00000100:00100000:1.0:1788329990.555762:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792254976 00000100:00100000:1.0:1788329990.555784:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788329990.555790:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc909047 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792254976:12345-0@lo:400: 00000100:00100000:1.0:1788329990.555823:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc909047 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792254976:12345-0@lo:400: Request processed in 34us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329990.555829:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788329990.555869:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a6efe686 x1875199792254976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788329990.555884:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6efe686 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792254976:0@lo:400: 00000100:00100000:1.0:1788329990.555910:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d25af5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792254848:0@lo:400: 00010000:00010000:2.0:1788329991.067533:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329992.092321:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329993.118789:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329994.139458:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329995.168381:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788329995.677354:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6efe686 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792255232:0@lo:400: 00000100:00100000:1.0:1788329995.677457:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329995.677732:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d25af5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792255104:0@lo:400: 00000100:00100000:0.0:1788329995.677784:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329995.677956:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792255104 00000100:00100000:1.0:1788329995.677965:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792255104 00000100:00100000:1.0:1788329995.678031:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788329995.678041:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000161da985 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:3649:x1875199792255104:12345-0@lo:400: 00000100:00100000:1.0:1788329995.678094:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000161da985 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:3649:x1875199792255104:12345-0@lo:400: Request processed in 55us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329995.678101:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788329995.678144:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d25af5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792255104:0@lo:400: 00000100:00100000:3.0:1788329995.678303:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792255232 00000100:00100000:3.0:1788329995.678307:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792255232 00000100:00100000:3.0:1788329995.678350:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788329995.678358:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f0d802d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792255232:12345-0@lo:400: 00000100:00100000:3.0:1788329995.678409:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f0d802d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792255232:12345-0@lo:400: Request processed in 52us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329995.678416:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788329995.678507:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a6efe686 x1875199792255232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329995.678530:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6efe686 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792255232:0@lo:400: 00010000:00010000:2.0:1788329996.187733:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788329996.495401:0:7452:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788329996.495407:0:7452:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788329996.495408:0:7452:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788329996.495762:0:7452:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000003d5f65ee 00000020:01000004:2.0:1788329996.495781:0:7452:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1788329996.495793:0:7452:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788329996.495809:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000008e4e492e) 00000020:00000080:2.0:1788329996.495826:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788329996.619389:0:7452:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1788329996.619479:0:7452:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1788329996.667966:0:7452:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788329996.668614:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788329996.668628:0:7452:0:(osd_handler.c:8927:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788329996.668641:0:7452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8475908e9fd0aad 00000020:01000004:2.0:1788329996.668649:0:7452:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788329996.668671:0:7452:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.150@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788329996.668674:0:7452:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788329996.668679:0:7452:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788329996.668711:0:7452:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788329996.668715:0:7452:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.150@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788329996.699789:0:7452:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788329996.699845:0:7452:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.150@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1788329996.699849:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788329996.699852:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788329996.699853:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788329996.699855:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788329996.699856:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788329996.699859:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788329996.699861:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788329996.699863:0:7452:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788329996.699865:0:7452:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788329996.699866:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788329996.699867:0:7452:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788329996.699872:0:7452:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1788329996.699875:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788329996.699876:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788329996.699877:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788329996.699878:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788329996.699879:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788329996.699880:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788329996.699881:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788329996.699882:0:7452:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788329996.699883:0:7452:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788329996.699889:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788329996.699890:0:7452:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788329996.699919:0:7452:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788329996.699940:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d25af5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792255360:0@lo:253: 00000100:00100000:1.0:1788329996.700097:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329996.700348:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ba2dcc5 going to sleep for 11 seconds 00000100:00100000:3.0:1788329996.704073:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792255360 00000100:00100000:3.0:1788329996.704093:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792255360 00000100:00100000:3.0:1788329996.704305:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788329996.704319:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000503f6a47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:7452:x1875199792255360:12345-0@lo:253: 20000000:01000000:3.0:1788329996.704358:0:6517:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788329996.704363:0:6517:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1788329996.704368:0:6517:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1788329996.704372:0:6517:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1788329996.704649:0:6517:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1788329996.704977:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788329996.705889:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788329996.705908:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788329996.705931:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1788329996.705951:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1788329996.705969:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1788329996.706057:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1788329996.706066:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1788329996.706082:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1788329996.706087:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1788329996.706104:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1788329996.706108:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1788329996.706119:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1788329996.706132:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1788329996.706499:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1788329996.706746:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.150@tcp (null) (null) (null) 00000040:00080000:2.0:1788329996.706765:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1788329996.706772:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788329996.706786:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1788329996.706791:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.150@tcp (null) (null) 00000040:00080000:2.0:1788329996.706803:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1788329996.706808:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788329996.706821:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1788329996.706834:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1788329996.706844:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788329996.706922:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1788329996.706932:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1788329996.706945:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1788329996.706961:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1788329996.706977:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1788329996.706983:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1788329996.706996:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1788329996.707029:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1788329996.707035:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1788329996.707058:0:6517:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788329996.707065:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1788329996.711117:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788329996.711889:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788329996.711922:0:6517:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.150@tcp for mdt 20000000:01000000:3.0:1788329996.711925:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.150@tcp (null) (null) (null) 00000040:00080000:3.0:1788329996.711942:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788329996.711950:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788329996.711963:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788329996.711986:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.150@tcp (null) (null) 00000040:00080000:3.0:1788329996.712003:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788329996.712078:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1788329996.712096:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1788329996.712112:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1788329996.712357:0:6517:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1788329996.712366:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1788329996.712958:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1788329996.719103:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788329996.719146:0:6517:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.150@tcp for mdt 20000000:01000000:2.0:1788329996.719769:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.150@tcp (null) (null) (null) 00000040:00080000:2.0:1788329996.719803:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788329996.719814:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788329996.719829:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788329996.719836:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.150@tcp (null) (null) 00000040:00080000:2.0:1788329996.719873:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788329996.719882:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1788329996.719896:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788329996.719916:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1788329996.719945:0:6517:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788329996.719949:0:6517:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788329996.719953:0:6517:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788329996.720003:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788329996.720006:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788329996.720752:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788329996.720777:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788329996.720790:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1788329996.722712:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788329996.722762:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788329996.722781:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1788329996.722799:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788329996.722801:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788329996.723769:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1788329996.723804:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1788329996.723822:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788329996.724020:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788329996.724043:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788329996.724073:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788329996.724084:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788329996.724086:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788329996.724711:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788329996.724731:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788329996.724745:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788329996.724874:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1788329996.724892:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1788329996.724906:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1788329996.724918:0:6517:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788329996.724920:0:6517:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788329996.724926:0:6517:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788329996.724932:0:6517:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788329996.725411:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1788329996.725516:0:6517:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788329996.736648:0:6517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788329996.736711:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006e074e9f/0x8475908e9fd0ab4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.736753:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000b1f3a29/0x8475908e9fd09e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd09e2 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.736761:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001ae44c4e/0x8475908e9fd0a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd09fe expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.736767:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000054480581/0x8475908e9fd0a75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0a6e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.736774:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006e074e9f/0x8475908e9fd0ab4 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.736821:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000054480581/0x8475908e9fd0a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0a6e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.736836:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000054480581/0x8475908e9fd0a75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0a6e expref: 12 pid: 6516 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329996.736850:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef374b69 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1875199792255488:0@lo:104: 00000100:00100000:2.0:1788329996.736922:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788329996.736995:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001ae44c4e/0x8475908e9fd0a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd09fe expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.737003:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001ae44c4e/0x8475908e9fd0a05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd09fe expref: 12 pid: 6515 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329996.737022:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002c2dff7f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1875199792255616:0@lo:104: 00000100:00100000:2.0:1788329996.737048:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788329996.737219:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000b1f3a29/0x8475908e9fd09e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd09e2 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.737233:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000b1f3a29/0x8475908e9fd09e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd09e2 expref: 12 pid: 6516 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329996.737251:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000911a63a2 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1875199792255744:0@lo:104: 00000100:00100000:2.0:1788329996.737274:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329996.737984:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set 0000000003694e1f going to sleep for 11 seconds 00000100:00100000:0.0:1788329996.738062:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792255488 00000100:00100000:0.0:1788329996.738071:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792255488 00000100:00100000:0.0:1788329996.738114:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792255616 00000100:00100000:0.0:1788329996.738116:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792255616 00000100:00100000:0.0:1788329996.738125:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792255744 00000100:00100000:0.0:1788329996.738127:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792255744 00000100:00100000:0.0:1788329996.738139:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788329996.738146:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cf67831 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+5:6517:x1875199792255488:12345-0@lo:104: 00010000:00010000:0.0:1788329996.738186:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: 00000000d1d178d0/0x8475908e9fd0a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0a75 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.738324:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788329996.738330:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cf67831 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+5:6517:x1875199792255488:12345-0@lo:104: Request processed in 185us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329996.738338:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788329996.738359:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788329996.738365:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9f35002 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:6517:x1875199792255616:12345-0@lo:104: 00010000:00010000:0.0:1788329996.738372:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd09fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0a05 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.738420:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788329996.738424:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9f35002 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:6517:x1875199792255616:12345-0@lo:104: Request processed in 61us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329996.738430:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788329996.738441:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788329996.738446:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc4cef10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:6517:x1875199792255744:12345-0@lo:104: 00010000:00010000:0.0:1788329996.738452:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: 00000000d149c57f/0x8475908e9fd09e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd09e9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.738476:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788329996.738479:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc4cef10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:6517:x1875199792255744:12345-0@lo:104: Request processed in 34us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329996.738485:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788329996.738641:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788329996.738648:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: 00000000d1d178d0/0x8475908e9fd0a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0a75 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.738655:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d1d178d0 already unused, calling callback (0000000099c7d1d5) 10000000:00010000:2.0:1788329996.738658:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: 00000000d1d178d0/0x8475908e9fd0a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0a75 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.738665:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: 00000000d1d178d0/0x8475908e9fd0a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0a75 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788329996.738671:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: 00000000d1d178d0/0x8475908e9fd0a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0a75 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788329996.738676:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788329996.738731:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: 00000000d1d178d0/0x8475908e9fd0a6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0a75 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.738738:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788329996.738761:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: 00000000d1d178d0/0x8475908e9fd0a6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0a75 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.738768:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: 00000000d1d178d0/0x8475908e9fd0a6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0a75 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.738790:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788329996.738792:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd09fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0a05 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.738798:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000794b474e already unused, calling callback (0000000099c7d1d5) 10000000:00010000:2.0:1788329996.738800:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd09fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0a05 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.738806:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd09fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0a05 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788329996.738812:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd09fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0a05 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788329996.738817:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788329996.738829:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd09fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0a05 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.738834:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788329996.738850:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd09fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0a05 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.738856:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd09fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0a05 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.738864:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788329996.738866:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: 00000000d149c57f/0x8475908e9fd09e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd09e9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.738882:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d149c57f already unused, calling callback (0000000099c7d1d5) 10000000:00010000:2.0:1788329996.738884:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: 00000000d149c57f/0x8475908e9fd09e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd09e9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.738890:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: 00000000d149c57f/0x8475908e9fd09e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd09e9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788329996.738895:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: 00000000d149c57f/0x8475908e9fd09e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd09e9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788329996.738900:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788329996.738913:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: 00000000d149c57f/0x8475908e9fd09e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd09e9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.738919:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788329996.738924:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: 00000000d149c57f/0x8475908e9fd09e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd09e9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.738929:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: 00000000d149c57f/0x8475908e9fd09e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd09e9 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.738943:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329996.738944:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329996.738945:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329996.738952:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788329996.738964:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034ca4f07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792255872:0@lo:103: 00000100:00100000:2.0:1788329996.738997:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329996.739221:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792255872 00000100:00100000:0.0:1788329996.739226:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792255872 00010000:00010000:0.0:1788329996.739319:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000054480581/0x8475908e9fd0a75 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0a6e expref: 13 pid: 6516 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329996.739348:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788329996.739355:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000446f52b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+13:3647:x1875199792255872:12345-0@lo:103: 00010000:00010000:0.0:1788329996.739366:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788329996.739369:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000054480581/0x8475908e9fd0a75 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0a6e expref: 13 pid: 6516 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.739379:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000054480581/0x8475908e9fd0a75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0a6e expref: 13 pid: 6516 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.739395:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788329996.739433:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000446f52b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+13:3647:x1875199792255872:12345-0@lo:103: Request processed in 79us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329996.739440:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788329996.739464:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c2fc40e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792256128:0@lo:103: 00000100:00100000:0.0:1788329996.739489:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329996.739589:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788329996.739596:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001531231e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792256000:0@lo:103: 00000100:00100000:0.0:1788329996.739618:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329996.739643:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792256128 00000100:00100000:0.0:1788329996.739647:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792256128 00010000:00010000:0.0:1788329996.739658:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000b1f3a29/0x8475908e9fd09e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd09e2 expref: 13 pid: 6516 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329996.739671:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792256000 00000100:00100000:0.0:1788329996.739674:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792256000 00010000:00010000:0.0:1788329996.739683:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001ae44c4e/0x8475908e9fd0a05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd09fe expref: 14 pid: 6515 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329996.739693:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788329996.739698:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5f3f9da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:3649:x1875199792256128:12345-0@lo:103: 00010000:00010000:0.0:1788329996.739704:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788329996.739707:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000b1f3a29/0x8475908e9fd09e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd09e2 expref: 14 pid: 6516 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.739713:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000b1f3a29/0x8475908e9fd09e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd09e2 expref: 14 pid: 6516 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.739721:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788329996.739746:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5f3f9da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:3649:x1875199792256128:12345-0@lo:103: Request processed in 48us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329996.739760:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788329996.739774:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788329996.739780:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028634d2e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+13:3649:x1875199792256000:12345-0@lo:103: 00010000:00010000:0.0:1788329996.739787:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788329996.739790:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001ae44c4e/0x8475908e9fd0a05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd09fe expref: 13 pid: 6515 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.739798:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001ae44c4e/0x8475908e9fd0a05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd09fe expref: 13 pid: 6515 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.739808:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006e074e9f/0x8475908e9fd0ab4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.739815:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006e074e9f/0x8475908e9fd0ab4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.739828:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006e074e9f/0x8475908e9fd0ab4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.739834:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006e074e9f/0x8475908e9fd0ab4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.739840:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006e074e9f/0x8475908e9fd0ab4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.739845:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006e074e9f/0x8475908e9fd0ab4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.739849:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006e074e9f already unused, calling callback (000000002f5b363c) 00010000:00010000:0.0:1788329996.739852:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006e074e9f/0x8475908e9fd0ab4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.739865:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006e074e9f/0x8475908e9fd0ab4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.739872:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006e074e9f/0x8475908e9fd0ab4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.739881:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788329996.739902:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028634d2e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+13:3649:x1875199792256000:12345-0@lo:103: Request processed in 123us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329996.739908:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788329996.739938:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001531231e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792256000:0@lo:103: 00000100:00100000:0.0:1788329996.739945:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c2fc40e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792256128:0@lo:103: 00010000:00010000:0.0:1788329996.739976:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000054480581/0x8475908e9fd0a75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0a6e expref: 12 pid: 6516 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329996.739988:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef374b69 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1875199792255488:0@lo:104: 00010000:00010000:0.0:1788329996.739998:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001ae44c4e/0x8475908e9fd0a05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd09fe expref: 11 pid: 6515 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329996.740004:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002c2dff7f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1875199792255616:0@lo:104: 00010000:00010000:0.0:1788329996.740131:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000b1f3a29/0x8475908e9fd09e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd09e2 expref: 10 pid: 6516 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329996.740141:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000911a63a2 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1875199792255744:0@lo:104: 00010000:00010000:0.0:1788329996.740179:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006e074e9f/0x8475908e9fd0ab4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.740198:0:6517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006e074e9f/0x8475908e9fd0ab4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.740214:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006e074e9f/0x8475908e9fd0ab4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.740219:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006e074e9f/0x8475908e9fd0ab4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788329996.740237:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788329996.745756:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034ca4f07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792255872:0@lo:103: 00000100:00100000:3.0:1788329996.746129:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000503f6a47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+9:7452:x1875199792255360:12345-0@lo:253: Request processed in 41812us (46031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329996.746142:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788329996.746934:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d25af5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792255360:0@lo:253: 10000000:01000000:1.0:1788329996.746950:0:7452:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788329996.746954:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788329996.746956:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788329996.746957:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788329996.746959:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1788329996.746960:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788329996.746961:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788329996.746962:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788329996.746964:0:7452:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788329996.746965:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788329996.746967:0:7452:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788329996.746985:0:7452:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003d5f65ee from lustre-MDT0001 10000000:01000000:1.0:1788329996.747030:0:7452:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788329996.747033:0:7452:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788329996.747039:0:7452:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99eee7570000 local copy 10000000:01000000:1.0:1788329996.747044:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788329996.747082:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 0000000031eaaaa3/0x8475908e9fd0abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329996.747106:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.150@tcp lock: 0000000031eaaaa3/0x8475908e9fd0abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329996.747115:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 0000000031eaaaa3/0x8475908e9fd0abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329996.747131:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d25af5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792256256:0@lo:101: 00000100:00100000:1.0:1788329996.747202:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329996.747440:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 0000000049d9b602 going to sleep for 11 seconds 00000100:00100000:2.0:1788329996.747632:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792256256 00000100:00100000:2.0:1788329996.747640:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792256256 00000100:00100000:2.0:1788329996.747688:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788329996.747697:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e54a7f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+9:7452:x1875199792256256:12345-0@lo:101: 00010000:00010000:2.0:1788329996.747709:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788329996.747723:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000db545e03/0x8475908e9fd0ac2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0abb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.747757:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000db545e03/0x8475908e9fd0ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0abb expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.747767:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000db545e03/0x8475908e9fd0ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0abb expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.747777:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000db545e03, rc 0) 00000100:00100000:2.0:1788329996.747817:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e54a7f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+10:7452:x1875199792256256:12345-0@lo:101: Request processed in 122us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329996.747824:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788329996.748842:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d25af5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792256256:0@lo:101: 00010000:00010000:1.0:1788329996.748862:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 0000000031eaaaa3/0x8475908e9fd0abb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8475908e9fd0ac2 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329996.748873:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 0000000031eaaaa3/0x8475908e9fd0abb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8475908e9fd0ac2 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329996.748989:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d25af5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792256384:0@lo:501: 00000100:00100000:1.0:1788329996.749107:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329996.749220:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 0000000049d9b602 going to sleep for 11 seconds 00000100:00100000:2.0:1788329996.749410:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792256384 00000100:00100000:2.0:1788329996.749416:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792256384 00000100:00100000:2.0:1788329996.749799:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788329996.749809:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000292aaff0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+10:7452:x1875199792256384:12345-0@lo:501: 00000100:00100000:2.0:1788329996.749898:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000292aaff0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+10:7452:x1875199792256384:12345-0@lo:501: Request processed in 91us (791us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788329996.749905:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788329996.749985:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d25af5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792256384:0@lo:501: 10000000:01000000:3.0:1788329996.750020:0:7452:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788329996.750043:0:7452:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788329996.750048:0:7452:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 0000000031eaaaa3/0x8475908e9fd0abb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8475908e9fd0ac2 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329996.750057:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 0000000031eaaaa3/0x8475908e9fd0abb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8475908e9fd0ac2 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329996.750064:0:7452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: 0000000031eaaaa3/0x8475908e9fd0abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8475908e9fd0ac2 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329996.750092:0:7452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788329996.750118:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99eef59c6800 10000000:01000000:3.0:1788329996.750123:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788329996.750129:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99eee7570000 10000000:01000000:3.0:1788329996.750131:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788329996.750134:0:7452:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99eee7570000 from 1 10000000:01000000:3.0:1788329996.750137:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788329996.750223:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 0000000092d531ed/0x8475908e9fd0ac9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329996.750231:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 0000000092d531ed/0x8475908e9fd0ac9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329996.750238:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 0000000092d531ed/0x8475908e9fd0ac9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.750392:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788329996.750398:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: 0000000031eaaaa3/0x8475908e9fd0abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8475908e9fd0ac2 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.750405:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000031eaaaa3 already unused, calling callback (0000000099c7d1d5) 10000000:00010000:0.0:1788329996.750408:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: 0000000031eaaaa3/0x8475908e9fd0abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8475908e9fd0ac2 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.750414:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: 0000000031eaaaa3/0x8475908e9fd0abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x8475908e9fd0ac2 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788329996.750420:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: 0000000031eaaaa3/0x8475908e9fd0abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x8475908e9fd0ac2 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788329996.750425:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788329996.750454:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: 0000000031eaaaa3/0x8475908e9fd0abb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8475908e9fd0ac2 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.750461:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788329996.750480:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: 0000000031eaaaa3/0x8475908e9fd0abb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8475908e9fd0ac2 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.750494:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: 0000000031eaaaa3/0x8475908e9fd0abb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8475908e9fd0ac2 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.750520:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329996.750521:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329996.750523:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788329996.750614:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e889129 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792256512:0@lo:101: 00000100:00100000:3.0:1788329996.750647:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329996.751255:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 000000007bfdf541 going to sleep for 11 seconds 00000100:00100000:3.0:1788329996.753399:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009e49035 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792256640:0@lo:103: 00000100:00100000:3.0:1788329996.753485:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329996.753572:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792256640 00000100:00100000:3.0:1788329996.753583:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792256640 00000100:00100000:3.0:1788329996.753647:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788329996.753657:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c23b96db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+10:3646:x1875199792256640:12345-0@lo:103: 00010000:00010000:3.0:1788329996.753672:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788329996.753692:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000db545e03/0x8475908e9fd0ac2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd0abb expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329996.753717:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788329996.753769:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c23b96db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+9:3646:x1875199792256640:12345-0@lo:103: Request processed in 115us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329996.753777:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788329996.753818:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009e49035 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792256640:0@lo:103: 00000100:00100000:1.0:1788329996.756225:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792256512 00000100:00100000:1.0:1788329996.757682:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792256512 00000100:00100000:1.0:1788329996.757766:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788329996.757776:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005abfbd53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+9:7452:x1875199792256512:12345-0@lo:101: 00010000:00010000:1.0:1788329996.757795:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788329996.757815:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b3ddce7e/0x8475908e9fd0ad0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0ac9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329996.757864:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b3ddce7e/0x8475908e9fd0ad0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0ac9 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329996.757873:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b3ddce7e/0x8475908e9fd0ad0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0ac9 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329996.757881:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b3ddce7e, rc 0) 00000100:00100000:1.0:1788329996.757958:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005abfbd53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+10:7452:x1875199792256512:12345-0@lo:101: Request processed in 184us (7311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329996.757965:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788329996.758673:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e889129 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792256512:0@lo:101: 00010000:00010000:3.0:1788329996.758705:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 0000000092d531ed/0x8475908e9fd0ac9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ad0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329996.758715:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 0000000092d531ed/0x8475908e9fd0ac9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0ad0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329996.758737:0:7452:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788329996.758752:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 0000000092d531ed/0x8475908e9fd0ac9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ad0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329996.758760:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 0000000092d531ed/0x8475908e9fd0ac9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ad0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329996.758772:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99eef59c6800 10000000:01000000:3.0:1788329996.758777:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788329996.758782:0:7452:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99eef59c6800 from 1 10000000:01000000:3.0:1788329996.758785:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788329996.758811:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 00000000c0815498/0x8475908e9fd0ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329996.758818:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 00000000c0815498/0x8475908e9fd0ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329996.758825:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 00000000c0815498/0x8475908e9fd0ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329996.758842:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e889129 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792256768:0@lo:101: 00000100:00100000:3.0:1788329996.758886:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329996.758919:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 000000007bfdf541 going to sleep for 11 seconds 00000100:00100000:1.0:1788329996.759070:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792256768 00000100:00100000:1.0:1788329996.759076:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792256768 00000100:00100000:1.0:1788329996.759100:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788329996.759105:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063a1c70a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+10:7452:x1875199792256768:12345-0@lo:101: 00010000:00010000:1.0:1788329996.759115:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788329996.759123:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000162cf285/0x8475908e9fd0ade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0ad7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329996.759137:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000162cf285/0x8475908e9fd0ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0ad7 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329996.759145:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000162cf285/0x8475908e9fd0ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0ad7 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329996.759172:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000162cf285, rc 0) 00000100:00100000:1.0:1788329996.759235:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063a1c70a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+11:7452:x1875199792256768:12345-0@lo:101: Request processed in 129us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329996.759382:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e889129 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792256768:0@lo:101: 00010000:00010000:3.0:1788329996.759399:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 00000000c0815498/0x8475908e9fd0ad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ade expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329996.759406:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 00000000c0815498/0x8475908e9fd0ad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0ade expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329996.759415:0:7452:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788329996.759422:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 00000000c0815498/0x8475908e9fd0ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ade expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329996.759428:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 00000000c0815498/0x8475908e9fd0ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ade expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329996.759434:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788329996.759437:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788329996.759442:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99eef59c6800 10000000:01000000:3.0:1788329996.759444:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788329996.759446:0:7452:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788329996.759448:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788329996.759459:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 0000000064e4823b/0x8475908e9fd0ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329996.759465:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 0000000064e4823b/0x8475908e9fd0ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329996.759471:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 0000000064e4823b/0x8475908e9fd0ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329996.759480:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e889129 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792256896:0@lo:101: 00000100:00100000:3.0:1788329996.759513:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329996.759527:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 000000007bfdf541 going to sleep for 11 seconds 00000100:00100000:1.0:1788329996.759801:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788329996.759836:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792256896 00000100:00100000:1.0:1788329996.759841:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792256896 00000100:00100000:1.0:1788329996.759858:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788329996.759864:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071362d1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+11:7452:x1875199792256896:12345-0@lo:101: 00010000:00010000:1.0:1788329996.759871:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788329996.759879:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ff6501a3/0x8475908e9fd0aec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0ae5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329996.759892:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ff6501a3/0x8475908e9fd0aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0ae5 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329996.759899:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ff6501a3/0x8475908e9fd0aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0ae5 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329996.759905:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ff6501a3, rc 0) 00000100:00100000:1.0:1788329996.759942:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071362d1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:7452:x1875199792256896:12345-0@lo:101: Request processed in 79us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329996.759947:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788329996.760032:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e889129 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792256896:0@lo:101: 00010000:00010000:3.0:1788329996.760041:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 0000000064e4823b/0x8475908e9fd0ae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0aec expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329996.760048:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 0000000064e4823b/0x8475908e9fd0ae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0aec expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329996.760136:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e889129 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792257024:0@lo:501: 00000100:00100000:3.0:1788329996.760182:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329996.760219:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 000000007bfdf541 going to sleep for 11 seconds 00000100:00100000:1.0:1788329996.760436:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792257024 00000100:00100000:1.0:1788329996.760441:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792257024 00000100:00100000:1.0:1788329996.760460:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788329996.760466:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1236b94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:7452:x1875199792257024:12345-0@lo:501: 00000100:00100000:1.0:1788329996.760593:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1236b94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:7452:x1875199792257024:12345-0@lo:501: Request processed in 127us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329996.760600:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788329996.760729:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e889129 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792257024:0@lo:501: 00000100:00100000:3.0:1788329996.760767:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e889129 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792257152:0@lo:503: 00000100:00100000:3.0:1788329996.760809:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329996.760839:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 000000007bfdf541 going to sleep for 11 seconds 00000100:00100000:1.0:1788329996.760914:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792257152 00000100:00100000:1.0:1788329996.760918:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792257152 00000100:00100000:1.0:1788329996.760938:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788329996.760942:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027c59a0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:7452:x1875199792257152:12345-0@lo:503: 00000100:00100000:1.0:1788329996.761068:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027c59a0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:7452:x1875199792257152:12345-0@lo:503: Request processed in 125us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329996.761075:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788329996.762622:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e889129 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792257152:0@lo:503: 00000040:00080000:3.0:1788329996.763452:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788329996.763648:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e889129 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792257280:0@lo:502: 00000100:00100000:3.0:1788329996.763722:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329996.763852:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ec503ba going to sleep for 11 seconds 00000100:00100000:1.0:1788329996.763907:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792257280 00000100:00100000:1.0:1788329996.763914:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792257280 00000100:00100000:1.0:1788329996.764021:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788329996.764030:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000747710cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:7452:x1875199792257280:12345-0@lo:502: 00000100:00100000:1.0:1788329996.764186:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000747710cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:7452:x1875199792257280:12345-0@lo:502: Request processed in 157us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329996.764193:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788329996.764404:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e889129 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792257280:0@lo:502: 00000040:00080000:3.0:1788329996.764640:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788329996.764669:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1788329996.764685:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1788329996.764698:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1788329996.764711:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1788329996.764723:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1788329996.764757:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1788329996.764774:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1788329996.764786:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1788329996.764797:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1788329996.764809:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1788329996.764823:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1788329996.764835:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1788329996.764848:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1788329996.764861:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1788329996.764873:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1788329996.764887:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1788329996.764899:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1788329996.764912:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1788329996.764928:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1788329996.764940:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1788329996.764952:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1788329996.764964:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1788329996.764991:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e889129 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792257408:0@lo:502: 00000100:00100000:3.0:1788329996.765047:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329996.768729:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ec503ba going to sleep for 11 seconds 00000100:00100000:1.0:1788329996.768790:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792257408 00000100:00100000:1.0:1788329996.768800:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792257408 00000100:00100000:0.0:1788329996.768877:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788329996.768889:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084962402 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:7452:x1875199792257408:12345-0@lo:502: 00000100:00100000:0.0:1788329996.769094:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084962402 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:7452:x1875199792257408:12345-0@lo:502: Request processed in 208us (4048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329996.769103:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788329996.769402:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e889129 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792257408:0@lo:502: 00000040:00080000:3.0:1788329996.769501:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1788329996.769532:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1788329996.770144:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788329996.770187:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329996.770190:0:7464:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788329996.770195:0:7464:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788329996.770198:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788329996.770224:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000910480a4) 00000020:00000080:3.0:1788329996.770270:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1788329996.770277:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788329996.770366:0:7464:0:(osd_handler.c:8927:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788329996.770373:0:7464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8475908e9fd0afa 00000020:00000080:3.0:1788329996.770729:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788329996.770734:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788329996.770737:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329996.770739:0:7464:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788329996.770741:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788329996.770755:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329996.770756:0:7464:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788329996.770760:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788329996.770768:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000a2639077) 00000020:00000080:3.0:1788329996.770779:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1788329996.770783:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788329996.770784:0:7464:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788329996.770787:0:7464:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788329996.770793:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788329996.770838:0:7464:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003d5f65ee from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788329996.770849:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000009f229528) 00000020:00000080:3.0:1788329996.770857:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1788329996.770929:0:7464:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788329996.770934:0:7464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd0b0f 00000020:00000080:3.0:1788329996.771050:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788329996.771057:0:7464:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788329996.771062:0:7464:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x8475908e9fd0b16 00080000:01000000:3.0:1788329996.771067:0:7464:0:(osd_handler.c:8927:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788329996.771070:0:7464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8475908e9fd0b1d 00080000:10000000:3.0:1788329996.771774:0:7464:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788329996.771903:0:7464:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1788329996.863635:0:7464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1788329996.863953:0:7464:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1788329996.865744:0:7464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788329996.866480:0:7464:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788329996.874491:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788329996.874520:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788329996.874534:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788329996.874536:0:7464:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788329996.874540:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788329996.874546:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788329996.874547:0:7464:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788329996.874550:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788329996.874555:0:7464:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:00000080:2.0:1788329996.874581:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788329996.874596:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000ec3b1f56) 00000020:00000080:2.0:1788329996.874623:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788329996.874628:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788329996.874712:0:7464:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788329996.874719:0:7464:0:(osd_handler.c:8927:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788329996.874733:0:7464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8475908e9fd0b2b 00010000:00080000:2.0:1788329996.874766:0:7464:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000537fcaec@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.150@tcp at head 00010000:00010000:2.0:1788329996.876400:0:7464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1788329996.877829:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788329996.877847:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788329996.877886:0:7464:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788329996.877908:0:7464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd0b32 00000100:00080000:0.0:1788329996.877919:0:7464:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788329996.877924:0:7464:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000537fcaec using connection 192.168.202.150@tcp/0@lo 00000100:00100000:0.0:1788329996.877975:0:7464:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f6cd7c09 x1875199792257536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788329996.878003:0:7464:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788329996.878221:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788329996.878225:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788329996.878227:0:7464:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788329996.878230:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788329996.878233:0:7464:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788329996.878234:0:7464:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788329996.878235:0:7464:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788329996.878312:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788329996.878315:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788329996.878317:0:7464:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788329996.878319:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788329996.878324:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788329996.878325:0:7464:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788329996.878329:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788329996.878365:0:7464:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788329996.878380:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788329996.878383:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788329996.878384:0:7464:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788329996.878387:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788329996.878389:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788329996.878390:0:7464:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788329996.878393:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788329996.878395:0:7464:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788329996.878425:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788329996.878428:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788329996.878429:0:7464:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788329996.878432:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:0.0:1788329996.878495:0:7452:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 00000100:00100000:2.0:1788329996.878626:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f6cd7c09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792257536:0@lo:38: 00000100:00100000:2.0:1788329996.878708:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329996.878793:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fd8f981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792257664:0@lo:400: 00000100:00100000:2.0:1788329996.878824:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329996.878856:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792257536 00000100:00100000:2.0:1788329996.878860:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792257664 00000100:00100000:2.0:1788329996.878865:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792257664 00000100:00100000:1.0:1788329996.878865:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792257536 00000100:00100000:1.0:1788329996.878899:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788329996.878900:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788329996.878906:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004efc82ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792257664:12345-0@lo:400: 00000100:00100000:1.0:1788329996.878906:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034ca4f07 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875199792257536:12345-0@lo:38: 00010000:00080000:1.0:1788329996.878930:0:6527:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000100:00100000:2.0:1788329996.878958:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004efc82ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792257664:12345-0@lo:400: Request processed in 52us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329996.878964:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:00000080:1.0:1788329996.878965:0:6527:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd0b39 00000004:00100000:1.0:1788329996.878980:0:6527:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788329996.878986:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00080000:2.0:1788329996.879005:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007fd8f981 x1875199792257664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788329996.879098:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fd8f981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792257664:0@lo:400: 10000000:01000000:0.0:1788329996.879659:0:7452:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788329996.879686:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 0000000064e4823b/0x8475908e9fd0ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0aec expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.879696:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 0000000064e4823b/0x8475908e9fd0ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0aec expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788329996.879705:0:7452:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99eef59c6800 from 1 10000000:01000000:0.0:1788329996.879707:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788329996.879739:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 0000000075bc078f/0x8475908e9fd0b40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.879757:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 0000000075bc078f/0x8475908e9fd0b40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.879767:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 0000000075bc078f/0x8475908e9fd0b40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329996.879783:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000088cf54e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792257792:0@lo:101: 00000100:00100000:0.0:1788329996.879822:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329996.879848:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f68cddf going to sleep for 11 seconds 00000100:00100000:2.0:1788329996.879973:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792257792 00000100:00100000:2.0:1788329996.879978:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792257792 00000100:00100000:2.0:1788329996.880084:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788329996.880093:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084bc480d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+12:7452:x1875199792257792:12345-0@lo:101: 00010000:00010000:2.0:1788329996.880104:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788329996.880115:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d149c57f/0x8475908e9fd0b47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0b40 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.880136:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d149c57f/0x8475908e9fd0b47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0b40 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.880147:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d149c57f/0x8475908e9fd0b47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0b40 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.880180:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d149c57f, rc 0) 00000100:00100000:2.0:1788329996.880224:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084bc480d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+13:7452:x1875199792257792:12345-0@lo:101: Request processed in 132us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329996.880230:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788329996.880418:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000088cf54e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792257792:0@lo:101: 00010000:00010000:0.0:1788329996.880432:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 0000000075bc078f/0x8475908e9fd0b40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0b47 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.880441:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 0000000075bc078f/0x8475908e9fd0b40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0b47 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329996.881136:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000088cf54e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792257920:0@lo:256: 00000100:00100000:0.0:1788329996.881360:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329996.881395:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f68cddf going to sleep for 11 seconds 00000100:00100000:0.0:1788329996.881424:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792257920 00000100:00100000:0.0:1788329996.881430:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792257920 00000100:00100000:0.0:1788329996.881474:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788329996.881481:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067470ac6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+13:7452:x1875199792257920:12345-0@lo:256: 20000000:01000000:0.0:1788329996.881734:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788329996.884232:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788329996.884254:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788329996.884436:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067470ac6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+13:7452:x1875199792257920:12345-0@lo:256: Request processed in 2953us (3074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329996.884458:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788329996.884686:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000088cf54e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792257920:0@lo:256: 10000000:01000000:3.0:1788329996.885276:0:7452:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788329996.885299:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 0000000075bc078f/0x8475908e9fd0b40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0b47 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329996.885320:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 0000000075bc078f/0x8475908e9fd0b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0b47 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329996.885328:0:7452:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eef59c6800 from 1 10000000:01000000:3.0:1788329996.885331:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788329996.885364:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 000000009360823e/0x8475908e9fd0b4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329996.885370:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 000000009360823e/0x8475908e9fd0b4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329996.885378:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 000000009360823e/0x8475908e9fd0b4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329996.885397:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e889129 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792258048:0@lo:101: 00000100:00100000:3.0:1788329996.885437:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329996.885473:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 00000000afbd2e06 going to sleep for 11 seconds 00000100:00100000:2.0:1788329996.886685:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792258048 00000100:00100000:2.0:1788329996.886699:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792258048 00000100:00100000:2.0:1788329996.886815:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788329996.886825:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0caa9ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+13:7452:x1875199792258048:12345-0@lo:101: 00010000:00010000:2.0:1788329996.886840:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788329996.886853:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001edfb23d/0x8475908e9fd0b55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0b4e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.886879:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001edfb23d/0x8475908e9fd0b55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0b4e expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.886898:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001edfb23d/0x8475908e9fd0b55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0b4e expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.886907:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001edfb23d, rc 0) 00000100:00100000:2.0:1788329996.886970:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0caa9ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:7452:x1875199792258048:12345-0@lo:101: Request processed in 147us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329996.886977:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788329996.887414:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e889129 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792258048:0@lo:101: 00010000:00010000:0.0:1788329996.887431:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 000000009360823e/0x8475908e9fd0b4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0b55 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.887450:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 000000009360823e/0x8475908e9fd0b4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0b55 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329996.887574:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792258176:0@lo:501: 00000100:00100000:0.0:1788329996.887608:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329996.888056:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f68cddf going to sleep for 11 seconds 00000100:00100000:3.0:1788329996.888133:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792258176 00000100:00100000:3.0:1788329996.888139:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792258176 00000100:00100000:3.0:1788329996.888291:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788329996.888300:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e102eb85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:7452:x1875199792258176:12345-0@lo:501: 00000100:00100000:3.0:1788329996.888449:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e102eb85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:7452:x1875199792258176:12345-0@lo:501: Request processed in 151us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329996.888456:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788329996.888605:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792258176:0@lo:501: 00000100:00100000:0.0:1788329996.888636:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792258304:0@lo:503: 00000100:00100000:0.0:1788329996.888677:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329996.888739:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f68cddf going to sleep for 11 seconds 00000100:00100000:3.0:1788329996.888767:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792258304 00000100:00100000:3.0:1788329996.888771:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792258304 00000100:00100000:3.0:1788329996.888836:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788329996.888842:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d86f8979 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:7452:x1875199792258304:12345-0@lo:503: 00000040:00080000:3.0:1788329996.888874:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788329996.888912:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d86f8979 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:7452:x1875199792258304:12345-0@lo:503: Request processed in 71us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329996.888918:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788329996.888971:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792258304:0@lo:503: 00000040:00080000:0.0:1788329996.889286:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788329996.889337:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1788329996.889407:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788329996.890141:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1788329996.890199:0:7452:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788329996.890235:0:7452:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788329996.890247:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 000000009360823e/0x8475908e9fd0b4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0b55 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.890257:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 000000009360823e/0x8475908e9fd0b4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0b55 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788329996.890315:0:7452:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788329996.890317:0:7452:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99eef59c6800 10000000:01000000:0.0:1788329996.890321:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99eef59c6800 10000000:01000000:0.0:1788329996.890324:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788329996.890330:0:7452:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99eef59c6800 from 1 10000000:01000000:0.0:1788329996.890333:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788329996.890361:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 00000000fb5c8ba8/0x8475908e9fd0b5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.890367:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 00000000fb5c8ba8/0x8475908e9fd0b5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.890377:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 00000000fb5c8ba8/0x8475908e9fd0b5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329996.890393:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792258432:0@lo:101: 00000100:00100000:0.0:1788329996.890436:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329996.890786:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b419199a going to sleep for 11 seconds 00000100:00100000:2.0:1788329996.890908:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792258432 00000100:00100000:2.0:1788329996.890915:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792258432 00000100:00100000:2.0:1788329996.890951:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788329996.890958:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091c599d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:7452:x1875199792258432:12345-0@lo:101: 00010000:00010000:2.0:1788329996.890968:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788329996.890980:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000db545e03/0x8475908e9fd0b63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0b5c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.891000:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000db545e03/0x8475908e9fd0b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0b5c expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.891070:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000db545e03/0x8475908e9fd0b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0b5c expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.891078:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000db545e03, rc 0) 00000100:00100000:2.0:1788329996.891126:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091c599d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:7452:x1875199792258432:12345-0@lo:101: Request processed in 169us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329996.891132:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788329996.891265:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792258432:0@lo:101: 00010000:00010000:0.0:1788329996.891280:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 00000000fb5c8ba8/0x8475908e9fd0b5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0b63 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329996.891289:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 00000000fb5c8ba8/0x8475908e9fd0b5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0b63 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329996.891368:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792258560:0@lo:501: 00000100:00100000:0.0:1788329996.891395:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329996.891432:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b419199a going to sleep for 11 seconds 00000100:00100000:2.0:1788329996.891532:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792258560 00000100:00100000:2.0:1788329996.891537:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792258560 00000100:00100000:2.0:1788329996.891554:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788329996.891568:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a75d9685 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:7452:x1875199792258560:12345-0@lo:501: 00000100:00100000:2.0:1788329996.891674:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a75d9685 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:7452:x1875199792258560:12345-0@lo:501: Request processed in 108us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329996.891681:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788329996.891820:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792258560:0@lo:501: 00000100:00100000:0.0:1788329996.891848:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792258688:0@lo:503: 00000100:00100000:0.0:1788329996.891887:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329996.891909:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b419199a going to sleep for 11 seconds 00000100:00100000:2.0:1788329996.891946:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792258688 00000100:00100000:2.0:1788329996.891950:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792258688 00000100:00100000:2.0:1788329996.891965:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788329996.891969:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ff0a7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:7452:x1875199792258688:12345-0@lo:503: 00000100:00100000:2.0:1788329996.892213:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ff0a7fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:7452:x1875199792258688:12345-0@lo:503: Request processed in 243us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329996.892222:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788329996.892495:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792258688:0@lo:503: 00000040:00080000:0.0:1788329996.892867:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788329996.892934:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792258816:0@lo:502: 00000100:00100000:0.0:1788329996.892975:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329996.893473:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b419199a going to sleep for 11 seconds 00000100:00100000:2.0:1788329996.893575:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792258816 00000100:00100000:2.0:1788329996.893582:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792258816 00000100:00100000:2.0:1788329996.893619:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788329996.893626:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed3007fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:7452:x1875199792258816:12345-0@lo:502: 00000100:00100000:2.0:1788329996.893769:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed3007fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:7452:x1875199792258816:12345-0@lo:502: Request processed in 143us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329996.893776:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788329996.894393:0:6527:0:(import.c:65:import_set_state_nolock()) 00000000458af24a : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788329996.894454:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034ca4f07 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875199792257536:12345-0@lo:38: Request processed in 15547us (15746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329996.894463:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788329996.894604:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788329996.894612:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788329996.894619:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788329996.894624:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788329996.894627:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000537fcaec lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788329996.894649:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f6cd7c09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792257536:0@lo:38: 00000100:00100000:1.0:1788329996.894798:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb0e13c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792258944:0@lo:41: 00000100:00100000:1.0:1788329996.894842:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329996.894927:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792258944 00000100:00100000:3.0:1788329996.894932:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792258944 00000100:00100000:3.0:1788329996.894967:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788329996.894974:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ce019ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875199792258944:12345-0@lo:41: 00000004:00000024:3.0:1788329996.894996:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788329996.895045:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ce019ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875199792258944:12345-0@lo:41: Request processed in 73us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329996.895051:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788329996.895309:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb0e13c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792258944:0@lo:41: 00000100:00100000:0.0:1788329996.895386:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792258816:0@lo:502: 00000040:00080000:0.0:1788329996.895697:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788329996.895726:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788329996.895741:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788329996.895755:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788329996.895769:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788329996.895784:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788329996.895797:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788329996.895809:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788329996.895822:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788329996.895835:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788329996.895849:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788329996.895863:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788329996.895877:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788329996.895889:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788329996.895900:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788329996.895913:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788329996.895926:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788329996.895939:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788329996.895958:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788329996.895987:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788329996.896003:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788329996.896091:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788329996.896107:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788329996.896120:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788329996.896131:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788329996.896147:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788329996.896328:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788329996.896344:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1788329996.896372:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792259072:0@lo:502: 00000100:00100000:0.0:1788329996.896424:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329996.896531:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b419199a going to sleep for 11 seconds 00000100:00100000:3.0:1788329996.896974:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792259072 00000100:00100000:3.0:1788329996.896981:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792259072 00000100:00100000:3.0:1788329996.897126:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788329996.897135:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a350d8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:7452:x1875199792259072:12345-0@lo:502: 00000100:00100000:3.0:1788329996.897298:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a350d8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:7452:x1875199792259072:12345-0@lo:502: Request processed in 165us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329996.897306:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788329996.897446:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792259072:0@lo:502: 00000040:00080000:0.0:1788329996.897496:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788329996.897585:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788329996.898267:0:7470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788329996.898284:0:7470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000064a20568) 00000020:00000080:0.0:1788329996.898306:0:7470:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788329996.898391:0:7470:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003d5f65ee from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788329996.898395:0:7470:0:(tgt_mount.c:187:server_put_mount()) put mount 000000003d5f65ee from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788329996.898397:0:7470:0:(obd_mount.c:710:lustre_put_lsi()) put 000000003d5f65ee 3 00010000:00080000:0.0:1788329996.898425:0:7470:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cda3b06d@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.150@tcp at head 00010000:00010000:0.0:1788329996.900938:0:7470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1788329996.901396:0:7470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788329996.901449:0:7470:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788329996.901465:0:7470:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x8475908e9fd0b71 00000100:00080000:0.0:1788329996.901477:0:7470:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788329996.901482:0:7470:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000cda3b06d using connection 192.168.202.150@tcp/0@lo 00000100:00100000:0.0:1788329996.901595:0:7470:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000075766e94 x1875199792259200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788329996.901632:0:7470:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788329996.901966:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875199792259200:0@lo:38: 00000100:00100000:2.0:1788329996.902183:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329996.902721:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792259200 00000100:00100000:3.0:1788329996.902731:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792259200 00000100:00100000:3.0:1788329996.902771:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788329996.902778:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000911a63a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875199792259200:12345-0@lo:38: 00010000:00080000:3.0:1788329996.902803:0:6523:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:3.0:1788329996.902838:0:6523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x8475908e9fd0b78 00000040:00080000:0.0:1788329996.903092:0:7470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000004:00100000:3.0:1788329996.905774:0:6523:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788329996.905839:0:6523:0:(import.c:65:import_set_state_nolock()) 00000000e431d610 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788329996.905950:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000911a63a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875199792259200:12345-0@lo:38: Request processed in 3169us (3797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329996.905962:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 40000000:00080000:3.0:1788329996.906082:0:7471:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00010000:00080000:2.0:1788329996.906543:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000075766e94 x1875199792259200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788330006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788329996.906556:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788329996.906564:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788329996.906572:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788329996.906577:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788329996.906579:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000cda3b06d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788329996.906585:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875199792259200:0@lo:38: 00000020:01000000:2.0:1788329996.906622:0:7452:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788329996.906660:0:7452:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788329996.906687:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 00000000fb5c8ba8/0x8475908e9fd0b5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0b63 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.906698:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 00000000fb5c8ba8/0x8475908e9fd0b5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0b63 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788329996.906757:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788329996.906759:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788329996.906761:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788329996.906762:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788329996.906763:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788329996.906765:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788329996.906776:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788329996.906779:0:7452:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788329996.906780:0:7452:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788329996.906781:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788329996.906783:0:7452:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788329996.906787:0:7452:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1788329996.906790:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788329996.906791:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788329996.906792:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788329996.906793:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788329996.906800:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788329996.906801:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788329996.906802:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788329996.906802:0:7452:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788329996.906803:0:7452:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788329996.906804:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788329996.906805:0:7452:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788329996.906827:0:7452:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788329996.906843:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002c2dff7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792259328:0@lo:253: 00000100:00100000:2.0:1788329996.906889:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329996.906916:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ce5c3649 going to sleep for 11 seconds 00000100:00100000:3.0:1788329996.907095:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792259328 00000100:00100000:3.0:1788329996.907102:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792259328 00000100:00100000:3.0:1788329996.907172:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788329996.907181:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000899c1b07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:7452:x1875199792259328:12345-0@lo:253: 20000000:01000000:3.0:1788329996.907213:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788329996.907229:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788329996.909765:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788329996.909842:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788329996.909860:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788329996.910387:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000899c1b07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:7452:x1875199792259328:12345-0@lo:253: Request processed in 3202us (3493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329996.910403:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 20000000:01000000:2.0:1788329996.910521:0:6538:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788329996.910527:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788329996.910552:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006e074e9f/0x8475908e9fd0b7f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.910569:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000363e7cb7/0x8475908e9fd0a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0a98 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.910577:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d149c57f/0x8475908e9fd0b47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0b40 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.910584:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006e074e9f/0x8475908e9fd0b7f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.910627:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d149c57f/0x8475908e9fd0b47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0b40 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.910641:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d149c57f/0x8475908e9fd0b47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0b40 expref: 14 pid: 6515 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329996.910654:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef374b69 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875199792259456:0@lo:104: 00000100:00100000:2.0:1788329996.910697:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788329996.910769:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000363e7cb7/0x8475908e9fd0a9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0a98 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.910777:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000363e7cb7/0x8475908e9fd0a9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0a98 expref: 14 pid: 6517 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329996.910784:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001531231e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875199792259584:0@lo:104: 00000100:00100000:2.0:1788329996.910806:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329996.910823:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set 00000000372935c9 going to sleep for 11 seconds 00000100:00100000:2.0:1788329996.910849:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792259456 00000100:00100000:2.0:1788329996.910857:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792259456 00000100:00100000:2.0:1788329996.910892:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792259584 00000100:00100000:2.0:1788329996.910895:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792259584 00000100:00100000:2.0:1788329996.910908:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788329996.910916:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c2fc40e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:6538:x1875199792259456:12345-0@lo:104: 00010000:00010000:2.0:1788329996.910930:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: 0000000075bc078f/0x8475908e9fd0b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0b47 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.910976:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788329996.910980:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c2fc40e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:6538:x1875199792259456:12345-0@lo:104: Request processed in 66us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329996.910987:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788329996.911002:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788329996.911147:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000635cd8d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:6538:x1875199792259584:12345-0@lo:104: 00010000:00010000:2.0:1788329996.911194:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: 00000000c6c89403/0x8475908e9fd0a98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0a9f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.911250:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788329996.911255:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000635cd8d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:6538:x1875199792259584:12345-0@lo:104: Request processed in 247us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329996.911267:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788329996.911284:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788329996.911289:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: 0000000075bc078f/0x8475908e9fd0b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0b47 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.911295:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000075bc078f already unused, calling callback (0000000099c7d1d5) 10000000:00010000:2.0:1788329996.911299:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: 0000000075bc078f/0x8475908e9fd0b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0b47 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.911306:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: 0000000075bc078f/0x8475908e9fd0b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0b47 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788329996.911313:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: 0000000075bc078f/0x8475908e9fd0b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0b47 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788329996.911318:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788329996.911348:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: 0000000075bc078f/0x8475908e9fd0b40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0b47 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.911355:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788329996.911373:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: 0000000075bc078f/0x8475908e9fd0b40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0b47 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.911379:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: 0000000075bc078f/0x8475908e9fd0b40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0b47 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.911393:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788329996.911396:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: 00000000c6c89403/0x8475908e9fd0a98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0a9f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.911412:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c6c89403 already unused, calling callback (0000000099c7d1d5) 10000000:00010000:2.0:1788329996.911414:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: 00000000c6c89403/0x8475908e9fd0a98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0a9f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.911419:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: 00000000c6c89403/0x8475908e9fd0a98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0a9f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788329996.911425:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: 00000000c6c89403/0x8475908e9fd0a98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0a9f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788329996.911430:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788329996.911443:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: 00000000c6c89403/0x8475908e9fd0a98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0a9f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.911449:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788329996.911462:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: 00000000c6c89403/0x8475908e9fd0a98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0a9f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.911468:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: 00000000c6c89403/0x8475908e9fd0a98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0a9f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.911483:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329996.911485:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329996.911486:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329996.911493:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788329996.911632:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002238fb0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792259840:0@lo:103: 00000100:00100000:2.0:1788329996.911665:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329996.911710:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792259840 00000100:00100000:2.0:1788329996.911714:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792259840 00010000:00010000:2.0:1788329996.911740:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000363e7cb7/0x8475908e9fd0a9f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0a98 expref: 15 pid: 6517 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329996.911765:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788329996.911772:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc65ef7f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:3646:x1875199792259840:12345-0@lo:103: 00010000:00010000:2.0:1788329996.911784:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788329996.911788:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000363e7cb7/0x8475908e9fd0a9f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0a98 expref: 15 pid: 6517 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.911797:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000363e7cb7/0x8475908e9fd0a9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0a98 expref: 15 pid: 6517 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.911813:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788329996.911841:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc65ef7f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:3646:x1875199792259840:12345-0@lo:103: Request processed in 70us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329996.911847:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788329996.911871:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000080fb8f9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792259712:0@lo:103: 00000100:00100000:2.0:1788329996.911898:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329996.911928:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792259712 00000100:00100000:2.0:1788329996.911932:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792259712 00010000:00010000:2.0:1788329996.911944:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d149c57f/0x8475908e9fd0b47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0b40 expref: 15 pid: 6515 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329996.911962:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788329996.911968:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e149d45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:3649:x1875199792259712:12345-0@lo:103: 00010000:00010000:2.0:1788329996.911975:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788329996.911978:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d149c57f/0x8475908e9fd0b47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0b40 expref: 15 pid: 6515 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.911986:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d149c57f/0x8475908e9fd0b47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0b40 expref: 15 pid: 6515 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.912003:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006e074e9f/0x8475908e9fd0b7f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.912476:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006e074e9f/0x8475908e9fd0b7f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788329996.912493:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009965961s 00010000:00010000:2.0:1788329996.912496:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006e074e9f/0x8475908e9fd0b7f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.912570:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006e074e9f/0x8475908e9fd0b7f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.912576:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006e074e9f/0x8475908e9fd0b7f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.912583:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006e074e9f/0x8475908e9fd0b7f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.912589:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006e074e9f already unused, calling callback (000000002f5b363c) 00010000:00010000:2.0:1788329996.912592:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006e074e9f/0x8475908e9fd0b7f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.912598:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006e074e9f/0x8475908e9fd0b7f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.912606:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006e074e9f/0x8475908e9fd0b7f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.912616:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788329996.912699:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e149d45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:3649:x1875199792259712:12345-0@lo:103: Request processed in 731us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329996.912713:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788329996.912786:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002238fb0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792259840:0@lo:103: 00010000:00010000:2.0:1788329996.912839:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d149c57f/0x8475908e9fd0b47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0b40 expref: 14 pid: 6515 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329996.912855:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef374b69 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875199792259456:0@lo:104: 00010000:00010000:2.0:1788329996.912865:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000363e7cb7/0x8475908e9fd0a9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0a98 expref: 13 pid: 6517 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329996.912873:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001531231e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875199792259584:0@lo:104: 00010000:00010000:2.0:1788329996.912886:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006e074e9f/0x8475908e9fd0b7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.912895:0:6538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006e074e9f/0x8475908e9fd0b7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.912900:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006e074e9f/0x8475908e9fd0b7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329996.912905:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006e074e9f/0x8475908e9fd0b7f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329996.916165:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002c2dff7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7452:1875199792259328:0@lo:253: 10000000:01000000:1.0:1788329996.916190:0:7452:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788329996.916193:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788329996.916195:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788329996.916197:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788329996.916198:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788329996.916199:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788329996.916200:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788329996.916212:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788329996.916214:0:7452:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788329996.916215:0:7452:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788329996.916217:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788329996.916218:0:7452:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788329996.916233:0:7452:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788329996.919306:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000080fb8f9c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792259712:0@lo:103: 00080000:10000000:1.0:1788329996.922861:0:7452:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1788329996.923456:0:7452:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788329996.927614:0:7452:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788329996.927812:0:7452:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788329996.928099:0:7452:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788329996.928605:0:7452:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1788329996.929548:0:7452:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788329996.929772:0:7452:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788329996.929963:0:7452:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1788329996.930117:0:7452:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1788329996.930674:0:7452:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1788329996.930882:0:7452:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1788329996.933123:0:7452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788329996.933709:0:7475:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788329996.933722:0:7475:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788329996.933835:0:7476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1788329996.933892:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001531231e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7476:1875199792259968:0@lo:700: 00000100:00100000:2.0:1788329996.933972:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329996.934032:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 0000000004629c18 going to sleep for 11 seconds 00000100:00100000:0.0:1788329996.934137:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792259968 00000100:00100000:0.0:1788329996.934145:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792259968 00000100:00100000:0.0:1788329996.934349:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788329996.934357:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef374b69 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7476:x1875199792259968:12345-0@lo:700: 00000040:01000000:3.0:1788329996.934888:0:7452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1788329996.935755:0:7477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ff2ada8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1875199792260096:0@lo:1000: 00000100:00100000:3.0:1788329996.935836:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329996.935883:0:7477:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb35b63b going to sleep for 11 seconds 00000100:00100000:0.0:1788329996.935934:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792260096 00000100:00100000:0.0:1788329996.935942:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792260096 00000100:00100000:0.0:1788329996.935988:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788329996.935996:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009b74d99 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1875199792260096:12345-0@lo:1000: 00000100:00100000:0.0:1788329996.936091:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009b74d99 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1875199792260096:12345-0@lo:1000: Request processed in 95us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329996.936099:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788329996.936276:0:7477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ff2ada8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1875199792260096:0@lo:1000: 00000040:01000000:3.0:1788329996.936318:0:7477:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1788329996.936343:0:7477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ff2ada8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1875199792260224:0@lo:700: 00000100:00100000:3.0:1788329996.936369:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329996.936389:0:7477:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a0658fa going to sleep for 11 seconds 00000100:00100000:0.0:1788329996.936636:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792260224 00000100:00100000:0.0:1788329996.936641:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792260224 00000100:00100000:0.0:1788329996.936667:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788329996.936673:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b7c5bcf pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7477:x1875199792260224:12345-0@lo:700: 00000100:00100000:0.0:1788329996.936719:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b7c5bcf pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7477:x1875199792260224:12345-0@lo:700: Request processed in 46us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329996.936725:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788329996.936752:0:7477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ff2ada8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1875199792260224:0@lo:700: 00000100:00100000:0.0:1788329996.936795:0:7477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037c136b2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7477:1875199792260352:0@lo:900: 00000100:00100000:0.0:1788329996.936824:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329996.936854:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792260352 00000100:00100000:0.0:1788329996.936857:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792260352 00000100:00100000:0.0:1788329996.936883:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788329996.936899:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6376ec pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7477:x1875199792260352:12345-0@lo:900: 00000100:00100000:0.0:1788329996.936933:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6376ec pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7477:x1875199792260352:12345-0@lo:900: Request processed in 36us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329996.936939:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788329996.936957:0:7477:0:(client.c:2715:ptlrpc_set_wait()) set 000000002fdbe7a6 going to sleep for 11 seconds 00010000:00080000:0.0:1788329996.936970:0:7477:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000037c136b2 x1875199792260352/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788330012 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329996.936980:0:7477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037c136b2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7477:1875199792260352:0@lo:900: 00000100:00100000:0.0:1788329996.937197:0:7477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037c136b2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1875199792260480:0@lo:1000: 00000100:00100000:0.0:1788329996.937968:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329996.938001:0:7477:0:(client.c:2715:ptlrpc_set_wait()) set 00000000970044e8 going to sleep for 11 seconds 00000100:00100000:3.0:1788329996.938181:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792260480 00000100:00100000:3.0:1788329996.938187:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792260480 00000100:00100000:3.0:1788329996.938229:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788329996.938256:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000565ef9da pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1875199792260480:12345-0@lo:1000: 00000040:01000000:2.0:1788329996.939117:0:7452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788329996.939480:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788329996.939981:0:7452:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788329996.939990:0:7452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788329996.941888:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788329996.942988:0:7452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1788329996.943389:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000565ef9da pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1875199792260480:12345-0@lo:1000: Request processed in 5129us (5417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329996.943402:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:2.0:1788329996.943947:0:7452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788329996.943988:0:7452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788329996.944437:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788329996.944733:0:7477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037c136b2 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1875199792260480:0@lo:1000: 00000004:00080000:3.0:1788329996.944801:0:7477:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000002fdbe7a6 with version 0 00000020:00100000:3.0:1788329996.944826:0:7477:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788329996.944833:0:7477:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000009c1bf122 x1875199792260736/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788329996.944852:0:7477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009c1bf122 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1875199792260736:0@lo:1000: 00000100:00100000:3.0:1788329996.944912:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329996.944952:0:7477:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb35b63b going to sleep for 11 seconds 00080000:10000000:2.0:1788329996.945269:0:7452:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788329996.946050:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788329996.946229:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788329996.946659:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788329996.946802:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788329996.946966:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000100:00100000:0.0:1788329996.947248:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792260736 00000100:00100000:0.0:1788329996.947260:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792260736 00000100:00100000:0.0:1788329996.947321:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788329996.947331:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd99ca69 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7477:x1875199792260736:12345-0@lo:1000: 00100000:10000000:2.0:1788329996.947743:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788329996.947918:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788329996.948055:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788329996.948291:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788329996.948435:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 40000000:02000000:1.0:1788329996.948785:0:6529:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:2.0:1788329996.949443:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00000001:00080000:0.0:1788329996.956394:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1788329996.956626:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd99ca69 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7477:x1875199792260736:12345-0@lo:1000: Request processed in 9292us (11711us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788329996.956640:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1788329996.956699:0:7477:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788329996.956704:0:7477:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788329996.956721:0:7477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009c1bf122 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1875199792260736:0@lo:1000: 00000100:00100000:0.0:1788329996.956820:0:7477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d18a538 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1875199792260864:0@lo:1000: 00000100:00100000:0.0:1788329996.956860:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329996.956894:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792260864 00000100:00100000:0.0:1788329996.956900:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792260864 00000100:00100000:0.0:1788329996.956944:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788329996.956952:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eff51156 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1875199792260864:12345-0@lo:1000: 00000100:00100000:0.0:1788329996.957299:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eff51156 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1875199792260864:12345-0@lo:1000: Request processed in 347us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329996.957306:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788329996.957335:0:7477:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fbdee756 going to sleep for 11 seconds 00000100:00100000:0.0:1788329996.957346:0:7477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d18a538 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1875199792260864:0@lo:1000: 00000040:00080000:0.0:1788329996.957360:0:7477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788329996.957392:0:7477:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000002fdbe7a6 with version 1 00100000:10000000:2.0:1788329996.961946:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788329996.962304:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788329996.962446:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788329996.962732:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788329996.962874:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788329996.963303:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788329996.963440:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00000100:00100000:1.0:1788329996.964115:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef374b69 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7476:x1875199792259968:12345-0@lo:700: Request processed in 29753us (30139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329996.964134:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788329996.964440:0:7476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001531231e x1875199792259968/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788330012 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788329996.964456:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001531231e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7476:1875199792259968:0@lo:700: 40000000:02000000:2.0:1788329996.964471:0:7476:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000004:00080000:3.0:1788329996.965169:0:7467:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000005d5898f version 1 rpc_version 1 00000020:00100000:3.0:1788329996.965215:0:7467:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788329996.965222:0:7467:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000cbd79634 x1875199792261120/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788329996.965308:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbd79634 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7467:1875199792261120:0@lo:1000: 00000100:00100000:3.0:1788329996.965364:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329996.965417:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb35b63b going to sleep for 11 seconds 00000100:00100000:1.0:1788329996.966192:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792261120 00000100:00100000:1.0:1788329996.966211:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792261120 00000100:00100000:1.0:1788329996.966612:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788329996.966623:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9ecb966 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1875199792261120:12345-0@lo:1000: 00000040:00080000:0.0:1788329996.966848:0:7477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788329996.966919:0:7477:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:3.0:1788329996.968233:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788329996.968722:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788329996.968875:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788329996.969617:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788329996.969784:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788329996.971788:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788329996.972674:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788329996.972863:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00000001:00080000:0.0:1788329996.974491:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1788329996.974728:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9ecb966 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7467:x1875199792261120:12345-0@lo:1000: Request processed in 8102us (9358us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788329996.974744:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1788329996.974830:0:7467:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788329996.974834:0:7467:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788329996.974850:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbd79634 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7467:1875199792261120:0@lo:1000: 00100000:10000000:3.0:1788329996.975358:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788329996.976347:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788329996.977088:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788329996.977421:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788329996.978257:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788329996.978452:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788329996.979086:0:7452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1788329996.993432:0:7452:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788329996.993486:0:7452:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb7bcc1ca7988 00100000:10000000:1.0:1788329996.993497:0:7452:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:0.0:1788329996.993695:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:01000004:2.0:1788329996.994436:0:7452:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788329996.994469:0:7452:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.150@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788329996.994490:0:7452:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788329996.994523:0:7452:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788329996.995415:0:7452:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788329996.995624:0:7452:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1788329997.014214:0:7476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788329997.016397:0:7476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1788329997.016405:0:7476:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1788329997.216189:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329998.235319:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329999.259374:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330000.286805:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330001.311577:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330002.332552:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330002.338772:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dc7d1e53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792261376:0@lo:400: 00000100:00100000:0.0:1788330002.338926:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005dc42f32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792261632:0@lo:400: 00000100:00100000:0.0:1788330002.338988:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330002.339073:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330002.339078:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2f7b92d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792261248:0@lo:400: 00000100:00100000:0.0:1788330002.339112:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330002.339184:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792261632 00000100:00100000:0.0:1788330002.339194:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792261632 00000100:00100000:0.0:1788330002.339283:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788330002.339293:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d18a538 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792261632:12345-0@lo:400: 00000100:00100000:0.0:1788330002.339354:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d18a538 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792261632:12345-0@lo:400: Request processed in 63us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330002.339362:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788330002.339411:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792261248 00000100:00100000:0.0:1788330002.339415:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792261248 00000100:00100000:0.0:1788330002.339446:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788330002.339451:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b77a2ac7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+13:3646:x1875199792261248:12345-0@lo:400: 00000100:00100000:0.0:1788330002.339481:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b77a2ac7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+13:3646:x1875199792261248:12345-0@lo:400: Request processed in 30us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330002.339487:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788330002.339547:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2f7b92d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792261248:0@lo:400: 00010000:00080000:0.0:1788330002.339563:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000005dc42f32 x1875199792261632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330002.339576:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005dc42f32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792261632:0@lo:400: 00000100:00100000:0.0:1788330002.339619:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006af90790 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792261504:0@lo:400: 00000100:00100000:0.0:1788330002.339650:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330002.339682:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792261504 00000100:00100000:0.0:1788330002.339685:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792261504 00000100:00100000:0.0:1788330002.339713:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788330002.339719:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053977bcf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792261504:12345-0@lo:400: 00000100:00100000:0.0:1788330002.339761:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053977bcf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792261504:12345-0@lo:400: Request processed in 42us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330002.339767:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788330002.339794:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006af90790 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792261504:0@lo:400: 00000100:00100000:1.0:1788330002.340232:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330002.340374:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792261376 00000100:00100000:3.0:1788330002.340380:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792261376 00000100:00100000:3.0:1788330002.340423:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788330002.340431:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ee2a8a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792261376:12345-0@lo:400: 00000100:00100000:3.0:1788330002.340477:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ee2a8a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792261376:12345-0@lo:400: Request processed in 47us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330002.340483:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788330002.340578:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d92b5aac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792261760:0@lo:41: 00000100:00100000:0.0:1788330002.340610:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330002.340685:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792261760 00000100:00100000:3.0:1788330002.340690:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792261760 00000100:00100000:3.0:1788330002.340717:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788330002.340724:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006207871e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792261760:12345-0@lo:41: 00000004:00000024:3.0:1788330002.340755:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788330002.340790:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006207871e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792261760:12345-0@lo:41: Request processed in 67us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330002.340796:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788330002.340959:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d92b5aac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792261760:0@lo:41: 00010000:00080000:1.0:1788330002.341040:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000dc7d1e53 x1875199792261376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330002.341052:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dc7d1e53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792261376:0@lo:400: 00000001:02000400:1.0:1788330002.544541:0:7722:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788330003.355706:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788330003.362355:0:7774:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788330003.362566:0:7774:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788330004.379984:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788330004.891952:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788330004.891963:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99eef59c6800 from 4 10000000:01000000:2.0:1788330004.891969:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788330004.892019:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 00000000b5fb433e/0x8475908e9fd0b86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330004.892035:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 00000000b5fb433e/0x8475908e9fd0b86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330004.892047:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 00000000b5fb433e/0x8475908e9fd0b86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330004.892072:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001531231e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792261888:0@lo:101: 00000100:00100000:2.0:1788330004.892226:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330004.892301:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ec04dc01 going to sleep for 11 seconds 00000100:00100000:3.0:1788330004.892392:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792261888 00000100:00100000:3.0:1788330004.892400:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792261888 00000100:00100000:3.0:1788330004.892478:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788330004.892487:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f8875e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+13:6519:x1875199792261888:12345-0@lo:101: 00010000:00010000:3.0:1788330004.892500:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330004.892513:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000363e7cb7/0x8475908e9fd0b8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0b86 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330004.892536:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000363e7cb7/0x8475908e9fd0b8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0b86 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330004.892546:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000363e7cb7/0x8475908e9fd0b8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0b86 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330004.892557:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000363e7cb7, rc 0) 00000100:00100000:3.0:1788330004.892601:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f8875e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:6519:x1875199792261888:12345-0@lo:101: Request processed in 115us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330004.892609:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788330004.892828:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001531231e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792261888:0@lo:101: 00010000:00010000:2.0:1788330004.892851:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 00000000b5fb433e/0x8475908e9fd0b86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0b8d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330004.892859:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 00000000b5fb433e/0x8475908e9fd0b86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0b8d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330004.892910:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001531231e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792262016:0@lo:256: 00000100:00100000:2.0:1788330004.892943:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330004.892966:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ec04dc01 going to sleep for 11 seconds 00000100:00100000:0.0:1788330004.893075:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792262016 00000100:00100000:0.0:1788330004.893080:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792262016 00000100:00100000:0.0:1788330004.893120:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788330004.893135:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1a1bb9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:6519:x1875199792262016:12345-0@lo:256: 20000000:01000000:0.0:1788330004.893171:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788330004.893189:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788330004.893193:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788330004.893282:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1a1bb9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:6519:x1875199792262016:12345-0@lo:256: Request processed in 156us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330004.893289:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788330004.893479:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001531231e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792262016:0@lo:256: 10000000:01000000:2.0:1788330004.893525:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788330004.893532:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 00000000b5fb433e/0x8475908e9fd0b86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0b8d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330004.893539:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 00000000b5fb433e/0x8475908e9fd0b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0b8d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330004.893550:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788330004.893552:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99eec865b000 from 21 10000000:01000000:2.0:1788330004.893555:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788330004.893572:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 0000000054480581/0x8475908e9fd0b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330004.893579:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 0000000054480581/0x8475908e9fd0b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330004.893585:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 0000000054480581/0x8475908e9fd0b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330004.893597:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001531231e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792262144:0@lo:101: 00000100:00100000:2.0:1788330004.893630:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330004.893664:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d0f6b19a going to sleep for 11 seconds 00000100:00100000:3.0:1788330004.893718:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792262144 00000100:00100000:3.0:1788330004.893723:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792262144 00000100:00100000:3.0:1788330004.893758:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788330004.893764:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000739476a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:6519:x1875199792262144:12345-0@lo:101: 00010000:00010000:3.0:1788330004.893772:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330004.893781:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000210efb1f/0x8475908e9fd0b9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0b94 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330004.893798:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000210efb1f/0x8475908e9fd0b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0b94 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330004.893806:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000210efb1f/0x8475908e9fd0b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0b94 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330004.893824:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000210efb1f, rc 0) 00000100:00100000:3.0:1788330004.893862:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000739476a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:6519:x1875199792262144:12345-0@lo:101: Request processed in 98us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330004.893868:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788330004.893943:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001531231e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792262144:0@lo:101: 00010000:00010000:2.0:1788330004.893954:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 0000000054480581/0x8475908e9fd0b94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0b9b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330004.893962:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 0000000054480581/0x8475908e9fd0b94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0b9b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330004.894011:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001531231e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792262272:0@lo:501: 00000100:00100000:2.0:1788330004.894036:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330004.894057:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d0f6b19a going to sleep for 11 seconds 00000100:00100000:0.0:1788330004.894081:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792262272 00000100:00100000:0.0:1788330004.894085:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792262272 00000100:00100000:0.0:1788330004.894197:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788330004.894204:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006248ee3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:6519:x1875199792262272:12345-0@lo:501: 00000100:00100000:0.0:1788330004.894336:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006248ee3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:6519:x1875199792262272:12345-0@lo:501: Request processed in 133us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330004.894352:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788330004.894510:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001531231e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792262272:0@lo:501: 00000100:00100000:2.0:1788330004.894538:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001531231e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792262400:0@lo:503: 00000100:00100000:2.0:1788330004.894579:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330004.901076:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d0f6b19a going to sleep for 11 seconds 00000100:00100000:3.0:1788330004.904892:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792262400 00000100:00100000:3.0:1788330004.905203:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792262400 00000100:00100000:3.0:1788330004.905279:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788330004.905290:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fdb72ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:6519:x1875199792262400:12345-0@lo:503: 00000100:00100000:3.0:1788330004.905512:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fdb72ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:6519:x1875199792262400:12345-0@lo:503: Request processed in 223us (10932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330004.905520:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788330004.905811:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001531231e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792262400:0@lo:503: 00000100:00100000:2.0:1788330004.910107:0:7826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001531231e pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7826:1875199792262528:0@lo:502: 00000100:00100000:2.0:1788330004.911103:0:7826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330004.911303:0:7826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eb3e9184 going to sleep for 11 seconds 00000100:00100000:1.0:1788330004.914411:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792262528 00000100:00100000:1.0:1788330004.914429:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792262528 00000100:00100000:1.0:1788330004.914580:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788330004.914606:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b15f52b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:7826:x1875199792262528:12345-0@lo:502: 00000100:00100000:1.0:1788330004.914806:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b15f52b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:7826:x1875199792262528:12345-0@lo:502: Request processed in 201us (3709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330004.914815:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788330004.914929:0:7826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001531231e pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7826:1875199792262528:0@lo:502: 00000100:00100000:2.0:1788330004.914996:0:7826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001531231e pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7826:1875199792262656:0@lo:502: 00000100:00100000:2.0:1788330004.915044:0:7826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330004.917980:0:7826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eb3e9184 going to sleep for 11 seconds 00000100:00100000:3.0:1788330004.918148:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792262656 00000100:00100000:3.0:1788330004.918172:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792262656 00000100:00100000:3.0:1788330004.918236:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788330004.918244:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8868e24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:7826:x1875199792262656:12345-0@lo:502: 00000100:00100000:3.0:1788330004.918522:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8868e24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:7826:x1875199792262656:12345-0@lo:502: Request processed in 278us (3478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330004.918530:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788330004.918649:0:7826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001531231e pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7826:1875199792262656:0@lo:502: 00000040:00080000:2.0:1788330004.918689:0:7826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788330004.919087:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788330004.919108:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788330004.919118:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 0000000054480581/0x8475908e9fd0b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0b9b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330004.919138:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 0000000054480581/0x8475908e9fd0b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0b9b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330004.921066:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788330004.921070:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99eec865b000 from 4 10000000:01000000:3.0:1788330004.921073:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788330004.921116:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 000000000b1f3a29/0x8475908e9fd0ba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330004.921134:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 000000000b1f3a29/0x8475908e9fd0ba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330004.921145:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 000000000b1f3a29/0x8475908e9fd0ba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330004.921188:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087929114 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792262784:0@lo:101: 00000100:00100000:3.0:1788330004.921263:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330004.921381:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 000000004c5b23b0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330004.922059:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792262784 00000100:00100000:0.0:1788330004.922072:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792262784 00000100:00100000:0.0:1788330004.924609:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788330004.924644:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034188b42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:6519:x1875199792262784:12345-0@lo:101: 00010000:00010000:0.0:1788330004.924668:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330004.924689:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000075bc078f/0x8475908e9fd0ba9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0ba2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330004.924752:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000075bc078f/0x8475908e9fd0ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0ba2 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330004.924763:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000075bc078f/0x8475908e9fd0ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0ba2 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330004.924771:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000075bc078f, rc 0) 00000100:00100000:0.0:1788330004.924873:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034188b42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792262784:12345-0@lo:101: Request processed in 249us (3611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330004.924880:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788330004.925020:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087929114 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792262784:0@lo:101: 00010000:00010000:3.0:1788330004.925042:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 000000000b1f3a29/0x8475908e9fd0ba2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ba9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330004.925054:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 000000000b1f3a29/0x8475908e9fd0ba2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0ba9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330004.925135:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087929114 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792262912:0@lo:256: 00000100:00100000:3.0:1788330004.925219:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330004.925717:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 000000004c5b23b0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330004.926647:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792262912 00000100:00100000:1.0:1788330004.926663:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792262912 00000100:00100000:1.0:1788330004.926720:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788330004.926730:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b7597c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792262912:12345-0@lo:256: 20000000:01000000:1.0:1788330004.926755:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788330004.926781:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788330004.926784:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788330004.926930:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b7597c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792262912:12345-0@lo:256: Request processed in 201us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330004.926938:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788330004.927635:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087929114 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792262912:0@lo:256: 10000000:01000000:3.0:1788330004.927706:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788330004.927724:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 000000000b1f3a29/0x8475908e9fd0ba2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ba9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330004.927735:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 000000000b1f3a29/0x8475908e9fd0ba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ba9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330004.927746:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788330004.927748:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788330004.927751:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788330004.927803:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 000000007182df34/0x8475908e9fd0bb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330004.927810:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 000000007182df34/0x8475908e9fd0bb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330004.927819:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 000000007182df34/0x8475908e9fd0bb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330004.927839:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087929114 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792263040:0@lo:101: 00000100:00100000:3.0:1788330004.927883:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330004.927943:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 000000004c5b23b0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330004.931561:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792263040 00000100:00100000:1.0:1788330004.931580:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792263040 00000100:00100000:1.0:1788330004.931640:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788330004.931650:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f39d856 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792263040:12345-0@lo:101: 00010000:00010000:1.0:1788330004.931668:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330004.931686:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000011996a8/0x8475908e9fd0bb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0bb0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330004.931714:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000011996a8/0x8475908e9fd0bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0bb0 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330004.931725:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000011996a8/0x8475908e9fd0bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0bb0 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330004.931734:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000011996a8, rc 0) 00000100:00100000:1.0:1788330004.931855:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f39d856 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792263040:12345-0@lo:101: Request processed in 206us (3972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330004.931863:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788330004.932212:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087929114 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792263040:0@lo:101: 00010000:00010000:3.0:1788330004.932232:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 000000007182df34/0x8475908e9fd0bb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0bb7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330004.932242:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 000000007182df34/0x8475908e9fd0bb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0bb7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330004.932332:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087929114 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792263168:0@lo:501: 00000100:00100000:3.0:1788330004.932380:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330004.932424:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 000000004c5b23b0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330004.932555:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792263168 00000100:00100000:1.0:1788330004.932561:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792263168 00000100:00100000:1.0:1788330004.932583:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788330004.932589:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f33e6e52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792263168:12345-0@lo:501: 00000100:00100000:1.0:1788330004.932718:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f33e6e52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792263168:12345-0@lo:501: Request processed in 129us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330004.932726:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788330004.932946:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087929114 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792263168:0@lo:501: 00000100:00100000:3.0:1788330004.932976:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087929114 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792263296:0@lo:503: 00000100:00100000:3.0:1788330004.933019:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330004.933043:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 000000004c5b23b0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330004.933221:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792263296 00000100:00100000:1.0:1788330004.933226:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792263296 00000100:00100000:1.0:1788330004.933259:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788330004.933265:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ce2e57e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792263296:12345-0@lo:503: 00000100:00100000:1.0:1788330004.933362:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ce2e57e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792263296:12345-0@lo:503: Request processed in 98us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330004.933369:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788330004.933800:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087929114 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792263296:0@lo:503: 00000100:00100000:1.0:1788330004.934513:0:7827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dc7d1e53 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7827:1875199792263424:0@lo:502: 00000100:00100000:1.0:1788330004.934565:0:7827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330004.934611:0:7827:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b596ce7 going to sleep for 11 seconds 00000100:00100000:3.0:1788330004.934671:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792263424 00000100:00100000:3.0:1788330004.934678:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792263424 00000100:00100000:3.0:1788330004.934725:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788330004.934733:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000407ab008 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:7827:x1875199792263424:12345-0@lo:502: 00000100:00100000:3.0:1788330004.934854:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000407ab008 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:7827:x1875199792263424:12345-0@lo:502: Request processed in 121us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330004.934862:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788330004.935199:0:7827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dc7d1e53 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7827:1875199792263424:0@lo:502: 00000020:01000000:1.0:1788330004.935227:0:7827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330004.935239:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330004.935242:0:7827:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788330004.935247:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788330004.935251:0:7827:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:00000080:1.0:1788330004.935274:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788330004.935298:0:7827:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000e8e07ccb) 00000020:00000080:1.0:1788330004.935320:0:7827:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1788330004.935327:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788330004.935420:0:7827:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788330004.935426:0:7827:0:(osd_handler.c:8927:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788330004.935442:0:7827:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd0bc5 00010000:00080000:1.0:1788330004.935475:0:7827:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000460de229@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.150@tcp at head 00010000:00010000:1.0:1788330004.944730:0:7827:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1788330004.951723:0:7827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788330004.951753:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788330004.951819:0:7827:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788330004.951849:0:7827:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd0bcc 00000100:00080000:0.0:1788330004.951863:0:7827:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788330004.951868:0:7827:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000460de229 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:0.0:1788330004.951914:0:7827:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fc6aa385 x1875199792263552/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788330004.951953:0:7827:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1788330004.951999:0:7827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1788330004.953582:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc6aa385 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792263552:0@lo:38: 00000100:00100000:2.0:1788330004.953674:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330004.954649:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792263552 00000100:00100000:1.0:1788330004.954660:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792263552 00000100:00100000:1.0:1788330004.954710:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788330004.954718:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001531231e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875199792263552:12345-0@lo:38: 00010000:00080000:1.0:1788330004.954779:0:6527:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:1.0:1788330004.954824:0:6527:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd0bd3 00000004:00100000:1.0:1788330004.954844:0:6527:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788330004.954850:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788330004.955326:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dc7d1e53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792263680:0@lo:400: 00000100:00100000:0.0:1788330004.955561:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330004.955595:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330004.955602:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099a987dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792263808:0@lo:400: 00000100:00100000:0.0:1788330004.955631:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330004.955673:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c39c810e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792263936:0@lo:400: 00000100:00100000:0.0:1788330004.955712:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330004.956618:0:6528:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788330004.956633:0:6528:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00080000:2.0:1788330004.956762:0:7830:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000002238fb0f x1875199792264064/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330004.956775:0:7830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f0cfb5a1 going to sleep for 0 seconds 00000100:00100000:2.0:1788330004.956821:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792263680 00000100:00100000:2.0:1788330004.956828:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792263680 00000100:00100000:2.0:1788330004.956875:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792263936 00000100:00100000:2.0:1788330004.956878:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792263936 00000100:00100000:2.0:1788330004.956894:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788330004.956901:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037c136b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792263680:12345-0@lo:400: 00000100:00100000:1.0:1788330004.957008:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788330004.957017:0:6522:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788330004.957214:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037c136b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792263680:12345-0@lo:400: Request processed in 312us (1653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330004.957221:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788330004.957239:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788330004.957245:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028634d2e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792263936:12345-0@lo:400: 00000100:00100000:2.0:1788330004.957278:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028634d2e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792263936:12345-0@lo:400: Request processed in 35us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330004.957284:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788330004.957572:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c39c810e x1875199792263936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330004.957586:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c39c810e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792263936:0@lo:400: 00000020:01000000:0.0:1788330004.957675:0:7827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788330004.957681:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330004.957683:0:7827:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788330004.957685:0:7827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788330004.957689:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330004.957690:0:7827:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788330004.957693:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788330004.957695:0:7827:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788330004.957721:0:7827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7827:1875199792264192:0@lo:502: 00000100:00100000:0.0:1788330004.957769:0:7827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330004.957801:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792264192 00000100:00100000:0.0:1788330004.957806:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792264192 00000100:00100000:0.0:1788330004.957839:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788330004.957847:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b29f55fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:7827:x1875199792264192:12345-0@lo:502: 00000100:00100000:0.0:1788330004.957971:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b29f55fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:7827:x1875199792264192:12345-0@lo:502: Request processed in 126us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330004.957978:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788330004.958030:0:7827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a9637617 going to sleep for 11 seconds 00000100:00100000:0.0:1788330004.958044:0:7827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:7827:1875199792264192:0@lo:502: 00000020:01000000:0.0:1788330004.958064:0:7827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788330004.958068:0:7827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330004.958069:0:7827:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788330004.958073:0:7827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1788330004.958138:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788330004.958204:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788330004.958214:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 000000007182df34/0x8475908e9fd0bb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0bb7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330004.958224:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 000000007182df34/0x8475908e9fd0bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0bb7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330004.958233:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788330004.958236:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99eee7570000 from 1 10000000:01000000:0.0:1788330004.958239:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788330004.958263:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd0bda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330004.958269:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd0bda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330004.958277:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd0bda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330004.958290:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792264320:0@lo:101: 00000100:00100000:0.0:1788330004.958320:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330004.958337:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a9637617 going to sleep for 11 seconds 00000100:00100000:0.0:1788330004.958350:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792264320 00000100:00100000:0.0:1788330004.958354:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792264320 00000100:00100000:0.0:1788330004.958377:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788330004.958383:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7e26af8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792264320:12345-0@lo:101: 00010000:00010000:0.0:1788330004.958390:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330004.958402:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d1d178d0/0x8475908e9fd0be1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0bda expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330004.958435:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d1d178d0/0x8475908e9fd0be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0bda expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330004.958444:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d1d178d0/0x8475908e9fd0be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0bda expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330004.958455:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d1d178d0, rc 0) 00000100:00100000:0.0:1788330004.958483:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7e26af8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792264320:12345-0@lo:101: Request processed in 100us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330004.958488:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788330004.958517:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792264320:0@lo:101: 00010000:00010000:0.0:1788330004.958529:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd0bda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0be1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330004.958537:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd0bda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0be1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330004.958584:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792264448:0@lo:501: 00000100:00100000:0.0:1788330004.958610:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330004.958623:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a9637617 going to sleep for 11 seconds 00000100:00100000:0.0:1788330004.958635:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792264448 00000100:00100000:0.0:1788330004.958638:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792264448 00000100:00100000:0.0:1788330004.958660:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788330004.958666:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfa7ab0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792264448:12345-0@lo:501: 00000100:00100000:0.0:1788330004.958733:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfa7ab0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792264448:12345-0@lo:501: Request processed in 67us (123us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788330004.958739:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788330004.958775:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792264448:0@lo:501: 10000000:01000000:0.0:1788330004.958795:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788330004.958798:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd0bda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0be1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330004.958805:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: 00000000794b474e/0x8475908e9fd0bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0be1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330004.959948:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792263808 00000100:00100000:3.0:1788330004.959963:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792263808 00000100:00100000:2.0:1788330004.960222:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788330004.960232:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5f3f9da pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792263808:12345-0@lo:400: 00000100:00100000:2.0:1788330004.960319:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5f3f9da pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792263808:12345-0@lo:400: Request processed in 90us (4688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330004.960327:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788330004.963293:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000dc7d1e53 x1875199792263680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330004.963319:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dc7d1e53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792263680:0@lo:400: 00000100:00100000:1.0:1788330004.963429:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099a987dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792263808:0@lo:400: 00000100:00080000:3.0:1788330004.970356:0:6527:0:(import.c:65:import_set_state_nolock()) 00000000a66bf277 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788330004.970528:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001531231e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875199792263552:12345-0@lo:38: Request processed in 15807us (16851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330004.970541:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788330004.970849:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788330004.970859:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788330004.970868:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788330004.970873:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788330004.970875:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000460de229 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788330004.970987:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f0cfb5a1): req@000000002238fb0f x1875199792264064/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330004.971009:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc6aa385 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792263552:0@lo:38: 00000100:00100000:2.0:1788330004.971118:0:7830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330004.971694:0:7830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f0cfb5a1 going to sleep for 11 seconds 00000100:00100000:2.0:1788330004.971838:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330004.971850:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099a987dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792264576:0@lo:41: 00000100:00100000:2.0:1788330004.971878:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330004.972070:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792264064 00000100:00100000:3.0:1788330004.972078:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792264064 00000100:00100000:3.0:1788330004.972135:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792264576 00000100:00100000:3.0:1788330004.972138:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792264576 00000100:00100000:1.0:1788330004.972372:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788330004.972384:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000446f52b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7830:x1875199792264064:12345-0@lo:1000: 00000100:00100000:1.0:1788330004.972473:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000446f52b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7830:x1875199792264064:12345-0@lo:1000: Request processed in 92us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330004.972480:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788330004.972523:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788330004.972528:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc65ef7f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792264576:12345-0@lo:41: 00000004:00000024:1.0:1788330004.972551:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788330004.972584:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc65ef7f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792264576:12345-0@lo:41: Request processed in 57us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330004.972590:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788330004.972721:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099a987dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792264576:0@lo:41: 00000100:00100000:2.0:1788330004.972748:0:7830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002238fb0f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7830:1875199792264064:0@lo:1000: 00000040:01000000:2.0:1788330004.972777:0:7830:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788330004.972808:0:7830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002238fb0f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7830:1875199792264704:0@lo:1000: 00000100:00100000:2.0:1788330004.972836:0:7830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330004.972857:0:7830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f0cfb5a1 going to sleep for 11 seconds 00000100:00100000:3.0:1788330004.972958:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792264704 00000100:00100000:3.0:1788330004.972963:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792264704 00000100:00100000:3.0:1788330004.972981:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788330004.972986:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080fb8f9c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7830:x1875199792264704:12345-0@lo:1000: 00000100:00100000:3.0:1788330004.973207:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080fb8f9c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7830:x1875199792264704:12345-0@lo:1000: Request processed in 220us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330004.973222:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788330004.973453:0:7830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002238fb0f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7830:1875199792264704:0@lo:1000: 00000100:00100000:2.0:1788330004.973494:0:7830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002238fb0f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7830:1875199792264832:0@lo:700: 00000100:00100000:2.0:1788330004.973518:0:7830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330004.973569:0:7830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eb3e9184 going to sleep for 11 seconds 00000100:00100000:3.0:1788330004.973606:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792264832 00000100:00100000:3.0:1788330004.973611:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792264832 00000100:00100000:3.0:1788330004.973666:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788330004.973673:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c2dff7f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7830:x1875199792264832:12345-0@lo:700: 00000100:00100000:3.0:1788330004.973719:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c2dff7f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7830:x1875199792264832:12345-0@lo:700: Request processed in 47us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330004.973725:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788330004.973765:0:7830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002238fb0f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7830:1875199792264832:0@lo:700: 00000100:00100000:2.0:1788330004.973929:0:7830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002238fb0f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7830:1875199792264960:0@lo:1000: 00000100:00100000:2.0:1788330004.973969:0:7830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330004.973996:0:7830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000015bf4f78 going to sleep for 11 seconds 00000100:00100000:1.0:1788330004.974082:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792264960 00000100:00100000:1.0:1788330004.974087:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792264960 00000100:00100000:1.0:1788330004.974118:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788330004.974135:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000416212d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7830:x1875199792264960:12345-0@lo:1000: 00000100:00100000:1.0:1788330004.974215:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000416212d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7830:x1875199792264960:12345-0@lo:1000: Request processed in 91us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330004.974221:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788330004.974392:0:7830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002238fb0f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7830:1875199792264960:0@lo:1000: 00000004:00080000:2.0:1788330004.974432:0:7830:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000eb3e9184 with version 0 00000020:00100000:2.0:1788330004.974445:0:7830:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788330004.974450:0:7830:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000006ecca4d7 x1875199792265216/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788330004.974464:0:7830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006ecca4d7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7830:1875199792265216:0@lo:1000: 00000100:00100000:2.0:1788330004.974492:0:7830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330004.974504:0:7830:0:(client.c:2715:ptlrpc_set_wait()) set 0000000015bf4f78 going to sleep for 11 seconds 00000100:00100000:1.0:1788330004.974604:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792265216 00000100:00100000:1.0:1788330004.974608:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792265216 00000100:00100000:1.0:1788330004.974636:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788330004.974642:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041fc659b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7830:x1875199792265216:12345-0@lo:1000: 00000001:00080000:1.0:1788330004.976631:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1788330004.976644:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788330004.976790:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041fc659b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7830:x1875199792265216:12345-0@lo:1000: Request processed in 2145us (2295us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788330004.976801:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1788330004.976843:0:7830:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788330004.976847:0:7830:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788330004.976861:0:7830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006ecca4d7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7830:1875199792265216:0@lo:1000: 00000100:00100000:2.0:1788330004.976964:0:7830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006ecca4d7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7830:1875199792265344:0@lo:1000: 00000100:00100000:2.0:1788330004.976999:0:7830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330004.977029:0:7830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d10e447c going to sleep for 11 seconds 00000100:00100000:2.0:1788330004.977048:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792265344 00000100:00100000:2.0:1788330004.977053:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792265344 00000100:00100000:2.0:1788330004.977091:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788330004.977099:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f96599ba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7830:x1875199792265344:12345-0@lo:1000: 00000100:00100000:2.0:1788330004.977206:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f96599ba pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7830:x1875199792265344:12345-0@lo:1000: Request processed in 108us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330004.977213:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788330004.977240:0:7830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006ecca4d7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7830:1875199792265344:0@lo:1000: 00000040:00080000:2.0:1788330004.977255:0:7830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788330004.977282:0:7830:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000015bf4f78 with version 1 00000040:00080000:2.0:1788330004.979547:0:7830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788330004.979644:0:7830:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788330004.979650:0:7830:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:1.0:1788330004.980084:0:7828:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000008688082f version 1 rpc_version 1 00000020:00100000:1.0:1788330004.980145:0:7828:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788330004.980199:0:7828:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000dc7d1e53 x1875199792265600/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788330004.980223:0:7828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dc7d1e53 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7828:1875199792265600:0@lo:1000: 00000100:00100000:1.0:1788330004.980330:0:7828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330004.980370:0:7828:0:(client.c:2715:ptlrpc_set_wait()) set 00000000df33c2de going to sleep for 11 seconds 00000100:00100000:2.0:1788330004.982759:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792265600 00000100:00100000:2.0:1788330004.982779:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792265600 00000100:00100000:2.0:1788330004.982912:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788330004.982943:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f75c2ddc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7828:x1875199792265600:12345-0@lo:1000: 00000001:00080000:1.0:1788330004.991452:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1788330004.993528:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f75c2ddc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7828:x1875199792265600:12345-0@lo:1000: Request processed in 10576us (13187us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788330004.993545:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:1.0:1788330004.993701:0:7828:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788330004.993711:0:7828:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788330004.993734:0:7828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dc7d1e53 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7828:1875199792265600:0@lo:1000: 00010000:00010000:1.0:1788330005.405400:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788330006.258255:0:7882:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788330006.258652:0:7882:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788330006.429486:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788330007.313428:0:7930:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0f4fd120 20000000:00000080:2.0:1788330007.313453:0:7930:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99eef5ab6400 uarg=0000000000000000 20000000:01000000:2.0:1788330007.313514:0:7930:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788330007.313523:0:7930:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788330007.313531:0:7930:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788330007.313740:0:7930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788330007.313756:0:7930:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788330007.318387:0:7930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788330007.318707:0:7930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788330007.318746:0:7930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788330007.318763:0:7930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788330007.318782:0:7930:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788330007.318807:0:7930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006e074e9f/0x8475908e9fd0be8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330007.318830:0:7930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000024aa7369/0x8475908e9fd0a67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0a60 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330007.318836:0:7930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001edfb23d/0x8475908e9fd0b55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0b4e expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330007.318843:0:7930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006e074e9f/0x8475908e9fd0be8 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330007.318893:0:7930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001edfb23d/0x8475908e9fd0b55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0b4e expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330007.318919:0:7930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001edfb23d/0x8475908e9fd0b55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0b4e expref: 17 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330007.318937:0:7930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006ecca4d7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7930:1875199792265728:0@lo:104: 00000100:00100000:2.0:1788330007.319030:0:7930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330007.319128:0:7930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000024aa7369/0x8475908e9fd0a67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0a60 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330007.319137:0:7930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000024aa7369/0x8475908e9fd0a67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0a60 expref: 17 pid: 6517 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330007.319180:0:7930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000520c0f93 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7930:1875199792265856:0@lo:104: 00000100:00100000:2.0:1788330007.319203:0:7930:0:(client.c:2715:ptlrpc_set_wait()) set 0000000015bf4f78 going to sleep for 11 seconds 00000100:00100000:3.0:1788330007.319299:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788330007.319321:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330007.319358:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792265728 00000100:00100000:3.0:1788330007.319368:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792265728 00000100:00100000:3.0:1788330007.319412:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792265856 00000100:00100000:3.0:1788330007.319415:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792265856 00000100:00100000:3.0:1788330007.319431:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788330007.319440:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052473041 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:7930:x1875199792265728:12345-0@lo:104: 00010000:00010000:3.0:1788330007.319454:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: 000000009360823e/0x8475908e9fd0b4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0b55 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.319518:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788330007.319523:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052473041 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:7930:x1875199792265728:12345-0@lo:104: Request processed in 84us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330007.319530:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788330007.319576:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788330007.319582:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087929114 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:7930:x1875199792265856:12345-0@lo:104: 00010000:00010000:3.0:1788330007.319599:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: 000000007184cbbb/0x8475908e9fd0a60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0a67 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.319639:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788330007.319643:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087929114 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:7930:x1875199792265856:12345-0@lo:104: Request processed in 63us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330007.319650:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788330007.319668:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330007.319674:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: 000000009360823e/0x8475908e9fd0b4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0b55 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.319682:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009360823e already unused, calling callback (0000000099c7d1d5) 10000000:00010000:3.0:1788330007.319687:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: 000000009360823e/0x8475908e9fd0b4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0b55 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.319696:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: 000000009360823e/0x8475908e9fd0b4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0b55 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330007.319704:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: 000000009360823e/0x8475908e9fd0b4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0b55 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330007.319710:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788330007.319747:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: 000000009360823e/0x8475908e9fd0b4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0b55 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.319754:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330007.319774:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: 000000009360823e/0x8475908e9fd0b4e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0b55 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.319781:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: 000000009360823e/0x8475908e9fd0b4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0b55 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.319808:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330007.319810:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: 000000007184cbbb/0x8475908e9fd0a60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0a67 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.319816:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007184cbbb already unused, calling callback (0000000099c7d1d5) 10000000:00010000:3.0:1788330007.319818:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: 000000007184cbbb/0x8475908e9fd0a60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0a67 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.319824:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: 000000007184cbbb/0x8475908e9fd0a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0a67 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330007.319829:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: 000000007184cbbb/0x8475908e9fd0a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0a67 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330007.319834:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788330007.319848:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: 000000007184cbbb/0x8475908e9fd0a60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0a67 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.319854:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330007.319859:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: 000000007184cbbb/0x8475908e9fd0a60 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0a67 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.319864:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: 000000007184cbbb/0x8475908e9fd0a60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0a67 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.319876:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330007.319878:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330007.319879:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330007.319902:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0d95308 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792266112:0@lo:103: 00000100:00100000:3.0:1788330007.319939:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330007.319969:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330007.319974:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0b8e756 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792265984:0@lo:103: 00000100:00100000:3.0:1788330007.319994:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330007.320021:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792266112 00000100:00100000:3.0:1788330007.320025:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792266112 00010000:00010000:3.0:1788330007.320043:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000024aa7369/0x8475908e9fd0a67 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0a60 expref: 18 pid: 6517 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330007.320064:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792265984 00000100:00100000:3.0:1788330007.320066:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792265984 00010000:00010000:3.0:1788330007.320075:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001edfb23d/0x8475908e9fd0b55 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0b4e expref: 19 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330007.320087:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788330007.320093:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c56da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:3649:x1875199792266112:12345-0@lo:103: 00010000:00010000:3.0:1788330007.320115:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330007.320120:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000024aa7369/0x8475908e9fd0a67 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0a60 expref: 19 pid: 6517 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.320130:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000024aa7369/0x8475908e9fd0a67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0a60 expref: 19 pid: 6517 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.320174:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330007.320203:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c56da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:3649:x1875199792266112:12345-0@lo:103: Request processed in 110us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330007.320209:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788330007.320222:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788330007.320226:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d92b5aac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:3649:x1875199792265984:12345-0@lo:103: 00010000:00010000:3.0:1788330007.320244:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330007.320248:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001edfb23d/0x8475908e9fd0b55 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0b4e expref: 18 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.320256:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001edfb23d/0x8475908e9fd0b55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0b4e expref: 18 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.320268:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006e074e9f/0x8475908e9fd0be8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.320275:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006e074e9f/0x8475908e9fd0be8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.320288:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006e074e9f/0x8475908e9fd0be8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.320295:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006e074e9f/0x8475908e9fd0be8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.320302:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006e074e9f/0x8475908e9fd0be8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.320307:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006e074e9f/0x8475908e9fd0be8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.320312:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006e074e9f already unused, calling callback (000000002f5b363c) 00010000:00010000:3.0:1788330007.320316:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006e074e9f/0x8475908e9fd0be8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.320322:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006e074e9f/0x8475908e9fd0be8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.320340:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006e074e9f/0x8475908e9fd0be8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330007.320350:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330007.320372:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d92b5aac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:3649:x1875199792265984:12345-0@lo:103: Request processed in 146us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330007.320378:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788330007.320420:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0b8e756 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792265984:0@lo:103: 00000100:00100000:3.0:1788330007.320427:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0d95308 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792266112:0@lo:103: 00010000:00010000:1.0:1788330007.320852:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330007.320886:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001edfb23d/0x8475908e9fd0b55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0b4e expref: 17 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330007.320902:0:7930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006ecca4d7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7930:1875199792265728:0@lo:104: 00010000:00010000:1.0:1788330007.320911:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000024aa7369/0x8475908e9fd0a67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0a60 expref: 16 pid: 6517 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330007.320917:0:7930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000520c0f93 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7930:1875199792265856:0@lo:104: 00010000:00010000:1.0:1788330007.320933:0:7930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006e074e9f/0x8475908e9fd0be8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330007.320941:0:7930:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006e074e9f/0x8475908e9fd0be8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330007.320947:0:7930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006e074e9f/0x8475908e9fd0be8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330007.320952:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006e074e9f/0x8475908e9fd0be8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330007.451396:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330007.451428:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc6aa385 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792266240:0@lo:41: 00000100:00100000:1.0:1788330007.451522:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330007.451631:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792266240 00000100:00100000:0.0:1788330007.451641:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792266240 00000100:00100000:0.0:1788330007.451706:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788330007.451717:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc7d1e53 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792266240:12345-0@lo:41: 00000004:00000024:0.0:1788330007.451761:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1788330007.451830:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc7d1e53 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792266240:12345-0@lo:41: Request processed in 115us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330007.451837:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788330007.451981:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc6aa385 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792266240:0@lo:41: 00010000:00010000:0.0:1788330007.452561:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330008.478183:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330009.501316:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330010.011471:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330010.012004:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f87d9b6d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792266496:0@lo:41: 00000100:00100000:1.0:1788330010.012143:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330010.012272:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792266496 00000100:00100000:1.0:1788330010.012282:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792266496 00000100:00100000:1.0:1788330010.012341:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788330010.012352:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048400280 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792266496:12345-0@lo:41: 00000004:00000024:1.0:1788330010.012399:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788330010.012448:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048400280 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792266496:12345-0@lo:41: Request processed in 98us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330010.012456:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788330010.012508:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f87d9b6d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792266496:0@lo:41: 00000100:00100000:1.0:1788330010.012699:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f6cd7c09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792266624:0@lo:400: 00000100:00100000:1.0:1788330010.012733:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330010.012768:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792266624 00000100:00100000:1.0:1788330010.012773:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792266624 00000100:00100000:1.0:1788330010.012803:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788330010.012810:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f87d9b6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792266624:12345-0@lo:400: 00000100:00100000:1.0:1788330010.012846:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f87d9b6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792266624:12345-0@lo:400: Request processed in 37us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330010.012853:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788330010.012883:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f6cd7c09 x1875199792266624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330010.012896:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f6cd7c09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792266624:0@lo:400: 00000100:00100000:3.0:1788330010.014628:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000088cf54e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792266752:0@lo:400: 00000100:00100000:3.0:1788330010.014713:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330010.014769:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792266368:0@lo:400: 00000100:00100000:3.0:1788330010.014801:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330010.014862:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792266368 00000100:00100000:3.0:1788330010.014871:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792266368 00000100:00100000:3.0:1788330010.014918:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788330010.014939:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d308cd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:3646:x1875199792266368:12345-0@lo:400: 00000100:00100000:3.0:1788330010.014991:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d308cd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:3646:x1875199792266368:12345-0@lo:400: Request processed in 54us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330010.014999:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788330010.015053:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075766e94 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792266368:0@lo:400: 00000100:00100000:1.0:1788330010.015143:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792266752 00000100:00100000:1.0:1788330010.015178:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792266752 00000100:00100000:1.0:1788330010.015220:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788330010.015226:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0d95308 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792266752:12345-0@lo:400: 00000100:00100000:1.0:1788330010.015282:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0d95308 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792266752:12345-0@lo:400: Request processed in 58us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330010.015288:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788330010.015314:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000088cf54e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792266752:0@lo:400: 00000100:00100000:2.0:1788330010.017973:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fd8f981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792266880:0@lo:400: 00000100:00100000:2.0:1788330010.018140:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330010.020466:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792266880 00000100:00100000:0.0:1788330010.020483:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792266880 00000100:00100000:0.0:1788330010.020556:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788330010.020567:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007f7f69e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792266880:12345-0@lo:400: 00000100:00100000:0.0:1788330010.020688:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007f7f69e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792266880:12345-0@lo:400: Request processed in 124us (2550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330010.020697:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788330010.022579:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007fd8f981 x1875199792266880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330010.022606:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fd8f981 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792266880:0@lo:400: 00010000:00010000:1.0:1788330010.523459:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330011.549318:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330012.571438:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330012.572343:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330012.572375:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f25af892 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792267008:0@lo:41: 00000100:00100000:1.0:1788330012.572477:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330012.572833:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792267008 00000100:00100000:1.0:1788330012.572844:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792267008 00000100:00100000:1.0:1788330012.572911:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788330012.572921:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008076636e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792267008:12345-0@lo:41: 00000004:00000024:1.0:1788330012.572970:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788330012.573036:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008076636e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792267008:12345-0@lo:41: Request processed in 117us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330012.573044:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788330012.573121:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f25af892 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792267008:0@lo:41: 10000000:01000000:0.0:1788330012.581277:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788330012.581289:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eef59c6800 from 1 10000000:01000000:0.0:1788330012.581296:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788330012.581356:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: 00000000b1783d12/0x8475908e9fd0bef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330012.581371:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: 00000000b1783d12/0x8475908e9fd0bef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330012.581385:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: 00000000b1783d12/0x8475908e9fd0bef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330012.581415:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009e49035 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792267136:0@lo:101: 00000100:00100000:0.0:1788330012.581515:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330012.581574:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 00000000981a8bb5 going to sleep for 11 seconds 00000100:00100000:0.0:1788330012.581608:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792267136 00000100:00100000:0.0:1788330012.581617:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792267136 00000100:00100000:0.0:1788330012.581677:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788330012.581818:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000308334e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792267136:12345-0@lo:101: 00010000:00010000:0.0:1788330012.581836:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330012.581850:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d50f7606/0x8475908e9fd0bf6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0bef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330012.581878:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d50f7606/0x8475908e9fd0bf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0bef expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330012.581905:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d50f7606/0x8475908e9fd0bf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0bef expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330012.581916:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d50f7606, rc 0) 00000100:00100000:0.0:1788330012.581962:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000308334e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792267136:12345-0@lo:101: Request processed in 147us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330012.581970:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788330012.582029:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009e49035 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792267136:0@lo:101: 00010000:00010000:0.0:1788330012.582045:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: 00000000b1783d12/0x8475908e9fd0bef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0bf6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330012.582064:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: 00000000b1783d12/0x8475908e9fd0bef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0bf6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330012.582289:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009e49035 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792267264:0@lo:501: 00000100:00100000:0.0:1788330012.582321:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330012.582347:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 00000000981a8bb5 going to sleep for 11 seconds 00000100:00100000:0.0:1788330012.582362:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792267264 00000100:00100000:0.0:1788330012.582366:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792267264 00000100:00100000:0.0:1788330012.582392:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788330012.582398:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ac842d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792267264:12345-0@lo:501: 00000100:00100000:0.0:1788330012.582536:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ac842d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792267264:12345-0@lo:501: Request processed in 138us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330012.582544:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788330012.582574:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009e49035 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792267264:0@lo:501: 00000100:00100000:0.0:1788330012.582601:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009e49035 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792267392:0@lo:503: 00000100:00100000:0.0:1788330012.582652:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330012.582666:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set 00000000981a8bb5 going to sleep for 11 seconds 00000100:00100000:0.0:1788330012.582678:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792267392 00000100:00100000:0.0:1788330012.583892:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792267392 00000100:00100000:0.0:1788330012.584006:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788330012.584015:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cef3af40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792267392:12345-0@lo:503: 00000100:00100000:0.0:1788330012.584346:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cef3af40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792267392:12345-0@lo:503: Request processed in 333us (1694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330012.584354:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788330012.584454:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009e49035 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792267392:0@lo:503: 00000100:00100000:2.0:1788330012.585911:0:8195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012080a2f pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8195:1875199792267520:0@lo:502: 00000100:00100000:2.0:1788330012.585999:0:8195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330012.586374:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792267520 00000100:00100000:0.0:1788330012.586384:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792267520 00000100:00100000:0.0:1788330012.586456:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788330012.586465:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000964dedac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:8195:x1875199792267520:12345-0@lo:502: 00000100:00100000:0.0:1788330012.586607:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000964dedac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:8195:x1875199792267520:12345-0@lo:502: Request processed in 143us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330012.586615:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788330012.586798:0:8195:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cf2a135d going to sleep for 11 seconds 00000100:00100000:2.0:1788330012.586820:0:8195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012080a2f pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8195:1875199792267520:0@lo:502: 00000020:01000000:2.0:1788330012.586853:0:8195:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330012.586866:0:8195:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330012.586875:0:8195:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788330012.586882:0:8195:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99eef59c6800 00000020:00000080:2.0:1788330012.586884:0:8195:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788330012.586943:0:8195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8195:1875199792267648:0@lo:502: 00000100:00100000:2.0:1788330012.586982:0:8195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330012.587008:0:8195:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3704e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788330012.587100:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792267648 00000100:00100000:1.0:1788330012.587107:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792267648 00000100:00100000:1.0:1788330012.587218:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788330012.587226:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:8195:x1875199792267648:12345-0@lo:502: 00000100:00100000:1.0:1788330012.587318:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:8195:x1875199792267648:12345-0@lo:502: Request processed in 93us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330012.587326:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788330012.587535:0:8195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8195:1875199792267648:0@lo:502: 00000020:01000000:2.0:1788330012.587557:0:8195:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330012.587562:0:8195:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330012.587565:0:8195:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788330012.587568:0:8195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788330012.587815:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788330012.587845:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788330012.587857:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0bef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0bf6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330012.587870:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0bef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0bf6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330012.587883:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788330012.587886:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eec865b000 from 1 10000000:01000000:1.0:1788330012.587889:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788330012.587920:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd0bfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330012.587929:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd0bfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330012.587939:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd0bfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330012.587954:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792267776:0@lo:101: 00000100:00100000:1.0:1788330012.587993:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330012.588024:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeca5810c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330012.588216:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792267776 00000100:00100000:2.0:1788330012.588221:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792267776 00000100:00100000:2.0:1788330012.588252:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788330012.588261:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792267776:12345-0@lo:101: 00010000:00010000:2.0:1788330012.588272:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330012.588285:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ef02064c00/0x8475908e9fd0c04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0bfd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330012.588310:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ef02064c00/0x8475908e9fd0c04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0bfd expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330012.588321:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ef02064c00/0x8475908e9fd0c04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0bfd expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330012.588331:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ef02064c00, rc 0) 00000100:00100000:2.0:1788330012.588360:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792267776:12345-0@lo:101: Request processed in 100us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330012.588366:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788330012.588447:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792267776:0@lo:101: 00010000:00010000:1.0:1788330012.588460:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd0bfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0c04 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330012.588471:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd0bfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0c04 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330012.588529:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792267904:0@lo:501: 00000100:00100000:1.0:1788330012.588561:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330012.588588:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeca5810c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330012.588669:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792267904 00000100:00100000:3.0:1788330012.588753:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792267904 00000100:00100000:3.0:1788330012.588781:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788330012.588788:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792267904:12345-0@lo:501: 00000100:00100000:3.0:1788330012.588918:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792267904:12345-0@lo:501: Request processed in 130us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330012.588926:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788330012.589031:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792267904:0@lo:501: 00000100:00100000:1.0:1788330012.589077:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792268032:0@lo:503: 00000100:00100000:1.0:1788330012.589297:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330012.589319:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeca5810c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330012.589373:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792268032 00000100:00100000:3.0:1788330012.589377:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792268032 00000100:00100000:3.0:1788330012.589437:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788330012.589445:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792268032:12345-0@lo:503: 00000100:00100000:3.0:1788330012.589538:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792268032:12345-0@lo:503: Request processed in 93us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330012.589546:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788330012.589723:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792268032:0@lo:503: 00000100:00100000:1.0:1788330012.590280:0:8196:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8196:1875199792268160:0@lo:502: 00000100:00100000:1.0:1788330012.590327:0:8196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330012.590399:0:8196:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeca581a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330012.590527:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792268160 00000100:00100000:3.0:1788330012.590533:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792268160 00000100:00100000:3.0:1788330012.590569:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788330012.590578:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:8196:x1875199792268160:12345-0@lo:502: 00000100:00100000:3.0:1788330012.590677:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:8196:x1875199792268160:12345-0@lo:502: Request processed in 100us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330012.590694:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788330012.590828:0:8196:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8196:1875199792268160:0@lo:502: 00000020:01000000:1.0:1788330012.590854:0:8196:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330012.590867:0:8196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330012.590870:0:8196:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788330012.590878:0:8196:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99eec865b000 00000020:00000080:1.0:1788330012.590881:0:8196:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788330012.590907:0:8196:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8196:1875199792268288:0@lo:502: 00000100:00100000:1.0:1788330012.590939:0:8196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330012.590960:0:8196:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeca581a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788330012.591022:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792268288 00000100:00100000:0.0:1788330012.591027:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792268288 00000100:00100000:0.0:1788330012.591049:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788330012.591068:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:8196:x1875199792268288:12345-0@lo:502: 00000100:00100000:0.0:1788330012.591285:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:8196:x1875199792268288:12345-0@lo:502: Request processed in 218us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330012.591292:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788330012.591371:0:8196:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8196:1875199792268288:0@lo:502: 00000020:01000000:1.0:1788330012.591388:0:8196:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330012.591393:0:8196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330012.591396:0:8196:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788330012.591399:0:8196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788330012.591566:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788330012.591588:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788330012.591600:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd0bfd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0c04 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330012.591625:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd0bfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0c04 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330013.599210:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330014.624006:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330015.132275:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792268416:0@lo:41: 00000100:00100000:2.0:1788330015.132370:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330015.134626:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792268416 00000100:00100000:1.0:1788330015.134646:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792268416 00000100:00100000:1.0:1788330015.134743:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330015.134754:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792268416:12345-0@lo:41: 00000004:00000024:1.0:1788330015.134797:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788330015.134890:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792268416:12345-0@lo:41: Request processed in 138us (2520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330015.134897:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330015.134977:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792268416:0@lo:41: 00000100:00100000:1.0:1788330015.136367:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792268800:0@lo:400: 00000100:00100000:1.0:1788330015.136432:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330015.136472:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788330015.136478:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792268928:0@lo:400: 00000100:00100000:1.0:1788330015.136506:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330015.136540:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792268928 00000100:00100000:1.0:1788330015.136547:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792268928 00000100:00100000:1.0:1788330015.136600:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788330015.136610:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792268928:12345-0@lo:400: 00000100:00100000:1.0:1788330015.136656:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792268928:12345-0@lo:400: Request processed in 47us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330015.136663:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788330015.136769:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792268544:0@lo:400: 00000100:00100000:3.0:1788330015.136804:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330015.136834:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330015.136839:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792268672:0@lo:400: 00000100:00100000:3.0:1788330015.136862:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330015.136891:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792268544 00000100:00100000:3.0:1788330015.136895:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792268544 00000100:00100000:3.0:1788330015.136934:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788330015.136941:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:3646:x1875199792268544:12345-0@lo:400: 00000100:00100000:3.0:1788330015.136977:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:3646:x1875199792268544:12345-0@lo:400: Request processed in 37us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330015.136984:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788330015.137014:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792268672 00000100:00100000:3.0:1788330015.137018:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792268672 00000100:00100000:3.0:1788330015.137050:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788330015.137056:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792268672:12345-0@lo:400: 00000100:00100000:3.0:1788330015.137087:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792268672:12345-0@lo:400: Request processed in 31us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330015.137093:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788330015.137134:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99eef58caa00 x1875199792268672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330015.137147:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792268672:0@lo:400: 00000100:00100000:3.0:1788330015.137186:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792268544:0@lo:400: 00000100:00100000:2.0:1788330015.137269:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792268800 00000100:00100000:2.0:1788330015.137273:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792268800 00000100:00100000:2.0:1788330015.137313:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788330015.137321:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792268800:12345-0@lo:400: 00000100:00100000:2.0:1788330015.137361:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792268800:12345-0@lo:400: Request processed in 41us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330015.137366:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788330015.137504:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99eef58c8000 x1875199792268928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330015.137514:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792268928:0@lo:400: 00000100:00100000:1.0:1788330015.137524:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792268800:0@lo:400: 00010000:00010000:2.0:1788330015.643270:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330016.686469:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788330017.666428:0:8431:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788330017.666432:0:8431:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788330017.666434:0:8431:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788330017.666585:0:8431:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99eefe782800 00000020:01000004:2.0:1788330017.666603:0:8431:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788330017.666618:0:8431:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788330017.666647:0:8431:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99eef6df0000) 00000020:00000080:2.0:1788330017.666665:0:8431:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1788330017.704734:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330017.709871:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792269056:0@lo:41: 00000100:00100000:3.0:1788330017.709947:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330017.710033:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792269056 00000100:00100000:3.0:1788330017.710049:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792269056 00000100:00100000:3.0:1788330017.710093:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788330017.710101:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792269056:12345-0@lo:41: 00000004:00000024:3.0:1788330017.710134:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788330017.710190:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792269056:12345-0@lo:41: Request processed in 89us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330017.710207:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788330017.710253:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792269056:0@lo:41: 00100000:10000000:0.0:1788330017.721911:0:8431:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788330017.721971:0:8431:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1788330017.759301:0:8431:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788330017.759533:0:8431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788330017.759547:0:8431:0:(osd_handler.c:8927:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788330017.759561:0:8431:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8475908e9fd0c12 00000020:01000004:2.0:1788330017.759568:0:8431:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788330017.759594:0:8431:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.150@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788330017.759597:0:8431:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788330017.759604:0:8431:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788330017.759609:0:8431:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788330017.759623:0:8431:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99eef6df3370) 00000020:00000080:2.0:1788330017.759645:0:8431:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788330017.761621:0:8431:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788330017.761858:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788330017.761866:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788330017.770122:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788330017.770138:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788330017.778422:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788330017.778438:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788330017.782460:0:8431:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788330017.782666:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788330017.782679:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788330017.786398:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788330017.786411:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788330017.829540:0:8431:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788330017.829916:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788330017.829923:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788330017.832412:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788330017.832429:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788330017.834270:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788330017.834299:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788330017.840465:0:8431:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788330017.840718:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788330017.840724:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788330017.841584:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788330017.841594:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788330017.916576:0:8431:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788330017.916974:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788330017.916982:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788330017.919411:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788330017.919528:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788330017.920335:0:8431:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788330017.920507:0:8431:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788330017.920514:0:8431:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788330017.938550:0:8431:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788330017.938605:0:8431:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.150@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788330017.938610:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788330017.938612:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788330017.938613:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330017.938615:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330017.938616:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330017.938618:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330017.938620:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788330017.938622:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788330017.938623:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788330017.938625:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330017.938626:0:8431:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788330017.938631:0:8431:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788330017.938633:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788330017.938634:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788330017.938636:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330017.938637:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330017.938638:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330017.938639:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330017.938640:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788330017.938641:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788330017.938642:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788330017.938643:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330017.938644:0:8431:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788330017.938676:0:8431:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788330017.938696:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792269184:0@lo:253: 00000100:00100000:1.0:1788330017.938782:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330017.938994:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec53fc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330017.939324:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792269184 00000100:00100000:2.0:1788330017.939331:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792269184 00000100:00100000:2.0:1788330017.939403:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788330017.939414:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:8431:x1875199792269184:12345-0@lo:253: 20000000:01000000:2.0:1788330017.939447:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788330017.939452:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788330017.939459:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788330017.939463:0:6516:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788330017.939702:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788330017.939860:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788330017.939876:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788330017.939894:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788330017.939900:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788330017.939913:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788330017.939926:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788330017.940017:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788330017.940796:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.150@tcp 20000000:01000000:2.0:1788330017.940811:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.150@tcp (null) (null) (null) 00000040:00080000:2.0:1788330017.940845:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788330017.940856:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788330017.940939:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788330017.940947:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.150@tcp (null) (null) 00000040:00080000:2.0:1788330017.940960:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788330017.940967:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788330017.940978:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788330017.940992:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788330017.941235:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1788330017.941249:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.150@tcp 20000000:01000000:2.0:1788330017.941251:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.150@tcp (null) (null) (null) 00000040:00080000:2.0:1788330017.941285:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1788330017.941293:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788330017.941306:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1788330017.941311:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.150@tcp (null) (null) 00000040:00080000:2.0:1788330017.941324:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1788330017.941330:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788330017.941343:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1788330017.941359:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1788330017.941733:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1788330017.941745:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.150@tcp 20000000:01000000:2.0:1788330017.941746:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.150@tcp (null) (null) (null) 00000040:00080000:2.0:1788330017.941759:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1788330017.941764:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788330017.941776:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1788330017.941781:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.150@tcp (null) (null) 00000040:00080000:2.0:1788330017.941793:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1788330017.941798:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788330017.943036:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1788330017.943434:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1788330017.943456:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788330017.943459:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788330017.943463:0:6516:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788330017.943536:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788330017.943539:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788330017.944570:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1788330017.944617:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1788330017.944635:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1788330017.945024:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1788330017.945123:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1788330017.945451:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1788330017.945467:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788330017.945470:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788330017.945981:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788330017.946399:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788330017.946422:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788330017.946453:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788330017.946465:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788330017.946467:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788330017.946763:0:8452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1788330017.946788:0:8452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1788330017.946816:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788330017.947015:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788330017.947036:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788330017.947133:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788330017.947143:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788330017.947145:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788330017.947545:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1788330017.947564:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1788330017.947579:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788330017.947716:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1788330017.947735:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1788330017.947747:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:2.0:1788330017.947760:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788330017.947782:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ef02064000/0x8475908e9fd0c20 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.947812:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eec147ac00/0x8475908e9fd0aec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0ae5 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.947821:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ef02064200/0x8475908e9fd0b63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0b5c expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.947837:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eeef91b600/0x8475908e9fd0b9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0b94 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.947843:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eec147b000/0x8475908e9fd0bb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0bb0 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.947849:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eec0031e00/0x8475908e9fd0be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0bda expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.947955:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ef02064000/0x8475908e9fd0c20 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.947996:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eec0031e00/0x8475908e9fd0be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0bda expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.948021:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eec0031e00/0x8475908e9fd0be1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0bda expref: 18 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330017.948036:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1875199792269312:0@lo:104: 00000100:00100000:2.0:1788330017.948370:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330017.948430:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eec147b000/0x8475908e9fd0bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0bb0 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.948439:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eec147b000/0x8475908e9fd0bb7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0bb0 expref: 18 pid: 6516 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330017.948449:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1875199792269440:0@lo:104: 00000100:00100000:2.0:1788330017.948471:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330017.948507:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eeef91b600/0x8475908e9fd0b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0b94 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.948525:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eeef91b600/0x8475908e9fd0b9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0b94 expref: 18 pid: 6516 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330017.948534:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1875199792269568:0@lo:104: 00000100:00100000:2.0:1788330017.948557:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330017.948573:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ef02064200/0x8475908e9fd0b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0b5c expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.948581:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ef02064200/0x8475908e9fd0b63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0b5c expref: 18 pid: 6516 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330017.948589:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1875199792269696:0@lo:104: 00000100:00100000:2.0:1788330017.948609:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330017.948625:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eec147ac00/0x8475908e9fd0aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0ae5 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.948633:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eec147ac00/0x8475908e9fd0aec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0ae5 expref: 18 pid: 6516 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330017.948641:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1875199792269824:0@lo:104: 00000100:00100000:2.0:1788330017.948660:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330017.948671:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec532ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788330017.948760:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792269312 00000100:00100000:0.0:1788330017.948768:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792269312 00000100:00100000:0.0:1788330017.948812:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792269440 00000100:00100000:0.0:1788330017.948815:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792269440 00000100:00100000:0.0:1788330017.948825:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792269568 00000100:00100000:0.0:1788330017.948827:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792269568 00000100:00100000:0.0:1788330017.948835:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792269696 00000100:00100000:0.0:1788330017.948836:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792269696 00000100:00100000:0.0:1788330017.948844:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792269824 00000100:00100000:0.0:1788330017.948846:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792269824 00000100:00100000:0.0:1788330017.948992:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788330017.949001:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+7:6516:x1875199792269312:12345-0@lo:104: 00010000:00010000:0.0:1788330017.949024:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec0031800/0x8475908e9fd0bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0be1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949175:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788330017.949181:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+7:6516:x1875199792269312:12345-0@lo:104: Request processed in 182us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330017.949188:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788330017.949207:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788330017.949213:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+6:6516:x1875199792269440:12345-0@lo:104: 00010000:00010000:0.0:1788330017.949222:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef59caa00/0x8475908e9fd0bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0bb7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949255:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788330017.949260:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+6:6516:x1875199792269440:12345-0@lo:104: Request processed in 48us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330017.949267:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788330017.949278:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788330017.949284:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+5:6516:x1875199792269568:12345-0@lo:104: 00010000:00010000:0.0:1788330017.949291:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99ef02065c00/0x8475908e9fd0b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0b9b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949313:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788330017.949318:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+5:6516:x1875199792269568:12345-0@lo:104: Request processed in 35us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330017.949324:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788330017.949334:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788330017.949348:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:6516:x1875199792269696:12345-0@lo:104: 00010000:00010000:0.0:1788330017.949355:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec0030a00/0x8475908e9fd0b5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0b63 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949380:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788330017.949385:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:6516:x1875199792269696:12345-0@lo:104: Request processed in 39us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330017.949389:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788330017.949401:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788330017.949406:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:6516:x1875199792269824:12345-0@lo:104: 00010000:00010000:0.0:1788330017.949412:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd0ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0aec expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949434:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788330017.949438:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:6516:x1875199792269824:12345-0@lo:104: Request processed in 33us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330017.949443:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788330017.949461:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788330017.949468:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec0031800/0x8475908e9fd0bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0be1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949475:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec0031800 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330017.949479:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec0031800/0x8475908e9fd0bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0be1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949487:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec0031800/0x8475908e9fd0bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0be1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330017.949494:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec0031800/0x8475908e9fd0bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0be1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330017.949507:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788330017.949540:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec0031800/0x8475908e9fd0bda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0be1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949546:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330017.949563:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec0031800/0x8475908e9fd0bda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0be1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949570:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec0031800/0x8475908e9fd0bda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0be1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949584:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788330017.949587:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef59caa00/0x8475908e9fd0bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0bb7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949593:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59caa00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330017.949596:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef59caa00/0x8475908e9fd0bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0bb7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949601:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef59caa00/0x8475908e9fd0bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0bb7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330017.949607:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef59caa00/0x8475908e9fd0bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0bb7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330017.949612:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788330017.949624:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef59caa00/0x8475908e9fd0bb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0bb7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949629:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330017.949653:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef59caa00/0x8475908e9fd0bb0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0bb7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949660:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef59caa00/0x8475908e9fd0bb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0bb7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949668:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788330017.949671:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99ef02065c00/0x8475908e9fd0b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0b9b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949677:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02065c00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330017.949679:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99ef02065c00/0x8475908e9fd0b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0b9b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949686:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99ef02065c00/0x8475908e9fd0b94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0b9b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330017.949692:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99ef02065c00/0x8475908e9fd0b94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0b9b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330017.949697:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788330017.949709:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99ef02065c00/0x8475908e9fd0b94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0b9b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949714:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330017.949719:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99ef02065c00/0x8475908e9fd0b94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0b9b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949726:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99ef02065c00/0x8475908e9fd0b94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0b9b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949734:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788330017.949742:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec0030a00/0x8475908e9fd0b5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0b63 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949747:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec0030a00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330017.949750:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec0030a00/0x8475908e9fd0b5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0b63 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949757:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec0030a00/0x8475908e9fd0b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0b63 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330017.949763:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec0030a00/0x8475908e9fd0b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0b63 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330017.949768:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788330017.949782:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec0030a00/0x8475908e9fd0b5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0b63 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949787:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330017.949791:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec0030a00/0x8475908e9fd0b5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0b63 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.949797:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec0030a00/0x8475908e9fd0b5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0b63 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330017.950964:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1875199792269312:0@lo:104: 00000100:00100000:2.0:1788330017.950976:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1875199792269440:0@lo:104: 00000100:00100000:2.0:1788330017.950984:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1875199792269568:0@lo:104: 00000100:00100000:2.0:1788330017.950990:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1875199792269696:0@lo:104: 00000100:00100000:2.0:1788330017.950996:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1875199792269824:0@lo:104: 00010000:00010000:2.0:1788330017.951237:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ef02064000/0x8475908e9fd0c20 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.951540:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330017.951545:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd0ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0aec expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.951552:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91a200 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330017.951556:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd0ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0aec expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.951577:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd0ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0aec expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330017.951584:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd0ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0aec expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330017.951590:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788330017.951624:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd0ae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0aec expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.951630:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330017.951638:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd0ae5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0aec expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.951644:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd0ae5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0aec expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.951658:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330017.951659:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330017.951661:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330017.951670:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330017.951694:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792269952:0@lo:103: 00000100:00100000:0.0:1788330017.951761:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330017.951979:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792270464:0@lo:103: 00000100:00100000:0.0:1788330017.952013:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330017.952205:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788330017.952212:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792270336:0@lo:103: 00000100:00100000:0.0:1788330017.952233:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330017.952350:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792270080:0@lo:103: 00000100:00100000:3.0:1788330017.952444:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792269952 00000100:00100000:3.0:1788330017.952453:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792269952 00010000:00010000:3.0:1788330017.952490:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eec0031e00/0x8475908e9fd0be1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0bda expref: 19 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330017.952526:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792270464 00000100:00100000:3.0:1788330017.952529:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792270464 00010000:00010000:3.0:1788330017.952541:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eec147ac00/0x8475908e9fd0aec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0ae5 expref: 20 pid: 6516 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330017.952556:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788330017.952566:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:3647:x1875199792269952:12345-0@lo:103: 00010000:00010000:3.0:1788330017.952581:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330017.952586:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eec0031e00/0x8475908e9fd0be1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0bda expref: 20 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330017.952598:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eec0031e00/0x8475908e9fd0be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0bda expref: 20 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330017.952612:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec0031e00/0x8475908e9fd0be1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0bda expref: 20 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330017.952630:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330017.952663:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:3647:x1875199792269952:12345-0@lo:103: Request processed in 99us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330017.952670:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788330017.952694:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788330017.952701:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7642a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:3647:x1875199792270464:12345-0@lo:103: 00010000:00010000:3.0:1788330017.952708:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330017.952712:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eec147ac00/0x8475908e9fd0aec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0ae5 expref: 18 pid: 6516 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330017.952721:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eec147ac00/0x8475908e9fd0aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0ae5 expref: 18 pid: 6516 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330017.952731:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec147ac00/0x8475908e9fd0aec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0ae5 expref: 18 pid: 6516 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330017.952740:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330017.952763:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7642a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:3647:x1875199792270464:12345-0@lo:103: Request processed in 64us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330017.952769:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788330017.953706:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792269952:0@lo:103: 00000100:00100000:0.0:1788330017.953718:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792270464:0@lo:103: 00000100:00100000:0.0:1788330017.953753:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792270208:0@lo:103: 00000100:00100000:0.0:1788330017.953794:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330017.953849:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792270336 00000100:00100000:0.0:1788330017.953865:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792270336 00010000:00010000:0.0:1788330017.953894:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ef02064200/0x8475908e9fd0b63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0b5c expref: 17 pid: 6516 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330017.953911:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792270208 00000100:00100000:0.0:1788330017.953914:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792270208 00010000:00010000:0.0:1788330017.953925:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eeef91b600/0x8475908e9fd0b9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0b94 expref: 18 pid: 6516 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330017.953939:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788330017.953946:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7641880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:3647:x1875199792270336:12345-0@lo:103: 00010000:00010000:0.0:1788330017.953955:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330017.953959:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ef02064200/0x8475908e9fd0b63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0b5c expref: 18 pid: 6516 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.953967:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ef02064200/0x8475908e9fd0b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0b5c expref: 18 pid: 6516 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.953981:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ef02064200/0x8475908e9fd0b63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0b5c expref: 18 pid: 6516 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.953997:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330017.954210:0:6508:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788330017.954220:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788330017.954298:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330017.954382:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7641880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:3647:x1875199792270336:12345-0@lo:103: Request processed in 95us (1805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330017.954407:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788330017.954423:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792270080 00000100:00100000:0.0:1788330017.954427:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792270080 00010000:00010000:0.0:1788330017.954442:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eec147b000/0x8475908e9fd0bb7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0bb0 expref: 17 pid: 6516 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330017.954454:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788330017.954459:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7641180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:3649:x1875199792270208:12345-0@lo:103: 00010000:00010000:0.0:1788330017.954467:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330017.954471:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eeef91b600/0x8475908e9fd0b9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0b94 expref: 17 pid: 6516 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.954479:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eeef91b600/0x8475908e9fd0b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0b94 expref: 17 pid: 6516 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.954490:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eeef91b600/0x8475908e9fd0b9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0b94 expref: 17 pid: 6516 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.954500:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330017.954529:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7641180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:3649:x1875199792270208:12345-0@lo:103: Request processed in 70us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330017.954535:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788330017.954549:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788330017.954555:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9301850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:3648:x1875199792270080:12345-0@lo:103: 00010000:00010000:0.0:1788330017.954562:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330017.954566:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eec147b000/0x8475908e9fd0bb7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0bb0 expref: 15 pid: 6516 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.954574:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eec147b000/0x8475908e9fd0bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0bb0 expref: 15 pid: 6516 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.954590:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec147b000/0x8475908e9fd0bb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0bb0 expref: 15 pid: 6516 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.954617:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ef02064000/0x8475908e9fd0c20 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.954626:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ef02064000/0x8475908e9fd0c20 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.954639:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ef02064000/0x8475908e9fd0c20 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.954647:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ef02064000/0x8475908e9fd0c20 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.954654:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ef02064000/0x8475908e9fd0c20 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.954661:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ef02064000/0x8475908e9fd0c20 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.954667:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02064000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330017.954672:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ef02064000/0x8475908e9fd0c20 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.954679:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ef02064000/0x8475908e9fd0c20 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330017.954751:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792270208:0@lo:103: 00010000:00010000:3.0:1788330017.956881:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ef02064000/0x8475908e9fd0c20 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330017.956901:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ef02064000/0x8475908e9fd0c20 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788330017.956910:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788330017.957387:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792270336:0@lo:103: 00010000:00010000:0.0:1788330017.958292:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ef02064000/0x8475908e9fd0c20 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.958321:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ef02064000/0x8475908e9fd0c20 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330017.958348:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330017.958454:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9301850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:3648:x1875199792270080:12345-0@lo:103: Request processed in 3897us (4153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330017.958466:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788330017.958598:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792270080:0@lo:103: 00000100:00100000:3.0:1788330017.964578:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+13:8431:x1875199792269184:12345-0@lo:253: Request processed in 25154us (25784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330017.964596:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788330017.964713:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792269184:0@lo:253: 10000000:01000000:1.0:1788330017.964732:0:8431:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788330017.964735:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788330017.964737:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788330017.964738:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330017.964739:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788330017.964740:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330017.964741:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330017.964743:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788330017.964744:0:8431:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788330017.964745:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330017.964747:0:8431:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788330017.964769:0:8431:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99eefe782800 from lustre-OST0000 10000000:01000000:1.0:1788330017.964811:0:8431:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788330017.964814:0:8431:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788330017.964823:0:8431:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99eee7570000 local copy 10000000:01000000:1.0:1788330017.964828:0:8431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788330017.964873:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0c27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330017.964884:0:8431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0c27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330017.964895:0:8431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0c27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330017.964915:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792270592:0@lo:101: 00000100:00100000:1.0:1788330017.964950:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330017.964989:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec53fc240 going to sleep for 11 seconds 00000100:00100000:3.0:1788330017.965184:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792270592 00000100:00100000:3.0:1788330017.965191:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792270592 00000100:00100000:3.0:1788330017.965247:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788330017.965274:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+13:8431:x1875199792270592:12345-0@lo:101: 00010000:00010000:3.0:1788330017.965287:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330017.965301:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef59ca200/0x8475908e9fd0c2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0c27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330017.965325:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef59ca200/0x8475908e9fd0c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0c27 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330017.965335:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef59ca200/0x8475908e9fd0c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0c27 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330017.965345:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59ca200, rc 0) 00000100:00100000:3.0:1788330017.965382:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:8431:x1875199792270592:12345-0@lo:101: Request processed in 112us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330017.965388:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788330017.965473:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792270592:0@lo:101: 00010000:00010000:2.0:1788330017.965488:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0c27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8475908e9fd0c2e expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.965497:0:8431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0c27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8475908e9fd0c2e expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330017.965604:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792270720:0@lo:501: 00000100:00100000:2.0:1788330017.965636:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330017.965662:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec532ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788330017.965705:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792270720 00000100:00100000:3.0:1788330017.965709:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792270720 00000100:00100000:3.0:1788330017.965735:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788330017.965741:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:8431:x1875199792270720:12345-0@lo:501: 00000100:00100000:3.0:1788330017.965797:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:8431:x1875199792270720:12345-0@lo:501: Request processed in 55us (160us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788330017.965813:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788330017.965845:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792270720:0@lo:501: 10000000:01000000:3.0:1788330017.965858:0:8431:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788330017.965874:0:8431:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788330017.965880:0:8431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0c27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8475908e9fd0c2e expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330017.965899:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0c27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8475908e9fd0c2e expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330017.965906:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8475908e9fd0c2e expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330017.965925:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788330017.965946:0:8431:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99eefe782800 10000000:01000000:3.0:1788330017.965950:0:8431:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788330017.965955:0:8431:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788330017.965957:0:8431:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788330017.965961:0:8431:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788330017.965963:0:8431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788330017.965977:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59ca000/0x8475908e9fd0c35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330017.965984:0:8431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef59ca000/0x8475908e9fd0c35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330017.965991:0:8431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef59ca000/0x8475908e9fd0c35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330017.966001:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792270848:0@lo:101: 00000100:00100000:3.0:1788330017.966035:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330017.968222:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792270848 00000100:00100000:2.0:1788330017.968240:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792270848 00000100:00100000:2.0:1788330017.968299:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788330017.968309:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:8431:x1875199792270848:12345-0@lo:101: 00010000:00010000:2.0:1788330017.968329:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330017.968347:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ef02065600/0x8475908e9fd0c3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0c35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.968375:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ef02065600/0x8475908e9fd0c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0c35 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.968385:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ef02065600/0x8475908e9fd0c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0c35 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.968411:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ef02065600, rc 0) 00000100:00100000:2.0:1788330017.968486:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8431:x1875199792270848:12345-0@lo:101: Request processed in 178us (2449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330017.968493:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788330017.970309:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330017.970360:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792270848:0@lo:101: 00010000:00010000:2.0:1788330017.970386:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef59ca000/0x8475908e9fd0c35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0c3c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.970398:0:8431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef59ca000/0x8475908e9fd0c35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0c3c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330017.970521:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792270976:0@lo:501: 00000100:00100000:2.0:1788330017.970576:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330017.970619:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792270976 00000100:00100000:2.0:1788330017.970624:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792270976 00000100:00100000:2.0:1788330017.970658:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788330017.970667:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8431:x1875199792270976:12345-0@lo:501: 00000100:00100000:2.0:1788330017.970812:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8431:x1875199792270976:12345-0@lo:501: Request processed in 132us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330017.970820:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788330017.970857:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec532e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788330017.970870:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792270976:0@lo:501: 00000100:00100000:2.0:1788330017.970906:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792271104:0@lo:503: 00000100:00100000:2.0:1788330017.970938:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330017.970964:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792271104 00000100:00100000:2.0:1788330017.970967:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792271104 00000100:00100000:2.0:1788330017.970982:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788330017.970987:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8431:x1875199792271104:12345-0@lo:503: 00000100:00100000:2.0:1788330017.971220:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8431:x1875199792271104:12345-0@lo:503: Request processed in 231us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330017.971227:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788330017.971260:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec532e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788330017.971271:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792271104:0@lo:503: 00000040:00080000:2.0:1788330017.972930:0:8431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788330017.973204:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792271232:0@lo:502: 00000100:00100000:2.0:1788330017.973278:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330017.973321:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec532e180 going to sleep for 11 seconds 00010000:00010000:2.0:1788330017.973433:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330017.973443:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8475908e9fd0c2e expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.973456:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147ba00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:2.0:1788330017.973461:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8475908e9fd0c2e expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.973472:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x8475908e9fd0c2e expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330017.973479:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x8475908e9fd0c2e expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330017.973485:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788330017.973510:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0c27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8475908e9fd0c2e expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.973524:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788330017.973589:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792271360:0@lo:103: 00000100:00100000:1.0:1788330017.973624:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330017.973682:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0c27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8475908e9fd0c2e expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.973690:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0c27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8475908e9fd0c2e expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330017.973706:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330017.973707:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330017.973709:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330017.973779:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792271232 00000100:00100000:3.0:1788330017.973786:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792271232 00000100:00100000:3.0:1788330017.973847:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788330017.973857:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8431:x1875199792271232:12345-0@lo:502: 00000100:00100000:3.0:1788330017.973982:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8431:x1875199792271232:12345-0@lo:502: Request processed in 125us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330017.973988:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788330017.974253:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792271232:0@lo:502: 00000040:00080000:2.0:1788330017.974544:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788330017.974577:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788330017.974590:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788330017.974602:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788330017.974614:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788330017.974625:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788330017.974652:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792271488:0@lo:502: 00000100:00100000:2.0:1788330017.974692:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330017.974714:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec532e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788330017.974991:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792271488 00000100:00100000:3.0:1788330017.974997:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792271488 00000100:00100000:3.0:1788330017.975053:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788330017.975062:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8431:x1875199792271488:12345-0@lo:502: 00000100:00100000:3.0:1788330017.975144:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8431:x1875199792271488:12345-0@lo:502: Request processed in 82us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330017.975178:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788330017.978506:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792271488:0@lo:502: 00000040:00080000:2.0:1788330017.978646:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788330017.978662:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788330017.979295:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788330017.979304:0:8455:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788330017.979312:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330017.979314:0:8455:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788330017.979320:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788330017.979352:0:8455:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99eef6df19b8) 00000020:00000080:2.0:1788330017.979383:0:8455:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788330017.979390:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788330017.979485:0:8455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99eefe782800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788330017.979494:0:8455:0:(osd_handler.c:8927:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788330017.979501:0:8455:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8475908e9fd0c4a 00000100:00100000:1.0:1788330017.981095:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792271360 00000100:00100000:1.0:1788330017.981114:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792271360 00000100:00100000:1.0:1788330017.981189:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788330017.981200:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:3648:x1875199792271360:12345-0@lo:103: 00010000:00010000:1.0:1788330017.981216:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330017.981238:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef59ca200/0x8475908e9fd0c2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd0c27 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330017.981256:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330017.981337:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:3648:x1875199792271360:12345-0@lo:103: Request processed in 140us (7712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330017.981344:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788330017.981378:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792271360:0@lo:103: 00010000:00010000:2.0:1788330017.986429:0:8455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1788330017.986906:0:8455:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788330017.997283:0:8455:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788330017.997716:0:8455:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788330018.007508:0:8455:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788330018.007794:0:8455:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788330018.014631:0:8455:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788330018.017275:0:8455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788330018.017293:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330018.017300:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330018.017302:0:8455:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788330018.017306:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330018.017310:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330018.017312:0:8455:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788330018.017314:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788330018.017316:0:8455:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788330018.017353:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330018.017356:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330018.017357:0:8455:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788330018.017360:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788330018.017559:0:8431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788330018.017591:0:8431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788330018.017621:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59ca000/0x8475908e9fd0c35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0c3c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330018.017634:0:8431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef59ca000/0x8475908e9fd0c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0c3c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330018.017643:0:8431:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eefe782800 from 1 10000000:01000000:0.0:1788330018.017646:0:8431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788330018.017690:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2600/0x8475908e9fd0c51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330018.017699:0:8431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef58c2600/0x8475908e9fd0c51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330018.017712:0:8431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef58c2600/0x8475908e9fd0c51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330018.017737:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792271616:0@lo:101: 00000100:00100000:0.0:1788330018.017827:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330018.017891:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eecaf9a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330018.018280:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792271616 00000100:00100000:3.0:1788330018.018288:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792271616 00000100:00100000:3.0:1788330018.018379:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788330018.018390:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:8431:x1875199792271616:12345-0@lo:101: 00010000:00010000:3.0:1788330018.018413:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330018.018428:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd0c58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0c51 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330018.018455:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd0c58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0c51 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330018.018466:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd0c58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0c51 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330018.018475:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cbc00, rc 0) 00000100:00100000:3.0:1788330018.018533:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8431:x1875199792271616:12345-0@lo:101: Request processed in 145us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330018.018541:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788330018.019338:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792271616:0@lo:101: 00010000:00010000:0.0:1788330018.019359:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef58c2600/0x8475908e9fd0c51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0c58 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330018.019369:0:8431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2600/0x8475908e9fd0c51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0c58 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330018.019499:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792271744:0@lo:501: 00000100:00100000:0.0:1788330018.019561:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330018.028463:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eecaf9a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330018.030913:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792271744 00000100:00100000:1.0:1788330018.030927:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792271744 00000100:00100000:1.0:1788330018.030985:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788330018.030996:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8431:x1875199792271744:12345-0@lo:501: 00000100:00100000:1.0:1788330018.031284:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8431:x1875199792271744:12345-0@lo:501: Request processed in 289us (11721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330018.031291:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788330018.031962:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792271744:0@lo:501: 00000100:00100000:1.0:1788330018.032025:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792271872:0@lo:503: 00000100:00100000:1.0:1788330018.032991:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330018.033552:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792271872 00000100:00100000:2.0:1788330018.033562:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792271872 00000100:00100000:2.0:1788330018.033618:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788330018.033627:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8431:x1875199792271872:12345-0@lo:503: 00000100:00100000:1.0:1788330018.033904:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec53fc240 going to sleep for 11 seconds 00000100:00100000:2.0:1788330018.034025:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8431:x1875199792271872:12345-0@lo:503: Request processed in 376us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330018.034032:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788330018.034282:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792271872:0@lo:503: 00000040:00080000:1.0:1788330018.034582:0:8431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788330018.034668:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792272000:0@lo:502: 00000100:00100000:1.0:1788330018.034711:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330018.034743:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee733eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330018.035740:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792272000 00000100:00100000:2.0:1788330018.035754:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792272000 00000100:00100000:2.0:1788330018.035892:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788330018.035903:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8431:x1875199792272000:12345-0@lo:502: 00000100:00100000:2.0:1788330018.036355:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8431:x1875199792272000:12345-0@lo:502: Request processed in 453us (1643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330018.036363:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788330018.036570:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792272000:0@lo:502: 00000040:00080000:0.0:1788330018.037665:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788330018.037712:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788330018.037755:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792272128:0@lo:502: 00000100:00100000:0.0:1788330018.037835:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330018.037879:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eecaf9a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788330018.037983:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792272128 00000100:00100000:3.0:1788330018.037990:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792272128 00000100:00100000:3.0:1788330018.038055:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788330018.038064:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8431:x1875199792272128:12345-0@lo:502: 00000100:00100000:3.0:1788330018.038219:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8431:x1875199792272128:12345-0@lo:502: Request processed in 155us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330018.038226:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788330018.038423:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792272128:0@lo:502: 00000040:00080000:0.0:1788330018.038473:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788330018.038482:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788330018.039199:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330018.039210:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330018.039212:0:8459:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788330018.039219:0:8459:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99eefe782800 00000020:00000080:1.0:1788330018.039221:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788330018.039231:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330018.039233:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330018.039235:0:8459:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788330018.039237:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788330018.039367:0:8431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788330018.039389:0:8431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788330018.039409:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2600/0x8475908e9fd0c51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0c58 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330018.039420:0:8431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef58c2600/0x8475908e9fd0c51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0c58 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330018.039470:0:8431:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788330018.039478:0:8431:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99eefe782800 10000000:01000000:0.0:1788330018.039482:0:8431:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99eefe782800 10000000:01000000:0.0:1788330018.039486:0:8431:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788330018.039492:0:8431:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99eefe782800 from 1 10000000:01000000:0.0:1788330018.039494:0:8431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788330018.039535:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c3a00/0x8475908e9fd0c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330018.039544:0:8431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef58c3a00/0x8475908e9fd0c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330018.039554:0:8431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef58c3a00/0x8475908e9fd0c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330018.039572:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792272256:0@lo:101: 00000100:00100000:0.0:1788330018.039624:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330018.039659:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eecaf9a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788330018.040415:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792272256 00000100:00100000:3.0:1788330018.040423:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792272256 00000100:00100000:3.0:1788330018.040472:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788330018.040480:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8431:x1875199792272256:12345-0@lo:101: 00010000:00010000:3.0:1788330018.040493:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330018.040506:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef59cb400/0x8475908e9fd0c66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0c5f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330018.040555:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef59cb400/0x8475908e9fd0c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0c5f expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330018.040566:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef59cb400/0x8475908e9fd0c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0c5f expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330018.040578:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cb400, rc 0) 00000100:00100000:3.0:1788330018.040667:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:8431:x1875199792272256:12345-0@lo:101: Request processed in 187us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330018.040673:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788330018.040953:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792272256:0@lo:101: 00010000:00010000:1.0:1788330018.040986:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef58c3a00/0x8475908e9fd0c5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0c66 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330018.040995:0:8431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef58c3a00/0x8475908e9fd0c5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0c66 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330018.041373:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792272384:0@lo:501: 00000100:00100000:1.0:1788330018.041411:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330018.041436:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec53fc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330018.041483:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792272384 00000100:00100000:2.0:1788330018.041488:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792272384 00000100:00100000:2.0:1788330018.041527:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788330018.041535:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:8431:x1875199792272384:12345-0@lo:501: 00000100:00100000:2.0:1788330018.041910:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:8431:x1875199792272384:12345-0@lo:501: Request processed in 375us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330018.041929:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788330018.041997:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792272384:0@lo:501: 00000100:00100000:1.0:1788330018.042033:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792272512:0@lo:503: 00000100:00100000:1.0:1788330018.042145:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330018.042192:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec53fc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330018.042253:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792272512 00000100:00100000:3.0:1788330018.042257:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792272512 00000100:00100000:3.0:1788330018.042282:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788330018.042288:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:8431:x1875199792272512:12345-0@lo:503: 00000100:00100000:3.0:1788330018.042374:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:8431:x1875199792272512:12345-0@lo:503: Request processed in 86us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330018.042381:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788330018.042490:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792272512:0@lo:503: 00000040:00080000:1.0:1788330018.042789:0:8431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788330018.042997:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792272640:0@lo:502: 00000100:00100000:1.0:1788330018.043118:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330018.043236:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eed302fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330018.046183:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792272640 00000100:00100000:2.0:1788330018.046201:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792272640 00000100:00100000:3.0:1788330018.046347:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788330018.046362:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:8431:x1875199792272640:12345-0@lo:502: 00000100:00100000:3.0:1788330018.046569:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:8431:x1875199792272640:12345-0@lo:502: Request processed in 211us (3451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330018.046578:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788330018.046695:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792272640:0@lo:502: 00000040:00080000:2.0:1788330018.047926:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788330018.047974:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788330018.047990:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788330018.048016:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788330018.048032:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788330018.048058:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788330018.048073:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788330018.048086:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788330018.048119:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788330018.048137:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788330018.048181:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788330018.048198:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788330018.048210:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788330018.048222:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788330018.048234:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788330018.048245:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788330018.048256:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788330018.048269:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788330018.048281:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788330018.048294:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788330018.048307:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788330018.048318:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788330018.048329:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788330018.048341:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788330018.048367:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788330018.048379:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788330018.048390:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788330018.048410:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788330018.048421:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788330018.048433:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788330018.048445:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788330018.048455:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788330018.048465:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788330018.048477:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788330018.048489:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788330018.048502:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788330018.048514:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1788330018.048559:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792272768:0@lo:502: 00000100:00100000:2.0:1788330018.048639:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330018.048688:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eed302fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788330018.048949:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792272768 00000100:00100000:0.0:1788330018.048958:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792272768 00000100:00100000:0.0:1788330018.049018:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788330018.049027:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:8431:x1875199792272768:12345-0@lo:502: 00000100:00100000:0.0:1788330018.049181:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:8431:x1875199792272768:12345-0@lo:502: Request processed in 154us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330018.049189:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788330018.049335:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792272768:0@lo:502: 00000040:00080000:2.0:1788330018.049390:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788330018.049398:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788330018.050033:0:8460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788330018.050112:0:8460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99eee76c3370) 00000020:00000080:1.0:1788330018.050139:0:8460:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788330018.050250:0:8460:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99eefe782800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788330018.050255:0:8460:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99eefe782800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788330018.050258:0:8460:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eefe782800 3 00010000:00080000:1.0:1788330018.050288:0:8460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc5f37000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.150@tcp at head 00010000:00010000:1.0:1788330018.053967:0:8460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1788330018.054360:0:8460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788330018.054412:0:8460:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788330018.054429:0:8460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8475908e9fd0c74 00000100:00080000:1.0:1788330018.054441:0:8460:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788330018.054447:0:8460:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99edc5f37000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330018.054487:0:8460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eef58cbb80 x1875199792272896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788330018.054512:0:8460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788330018.054735:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875199792272896:0@lo:38: 00000100:00100000:0.0:1788330018.054826:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330018.054991:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792272896 00000100:00100000:1.0:1788330018.054998:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792272896 00000100:00100000:1.0:1788330018.055106:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788330018.055114:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875199792272896:12345-0@lo:38: 00010000:00080000:1.0:1788330018.055139:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:1.0:1788330018.055284:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8475908e9fd0c7b 00000004:00100000:1.0:1788330018.055300:0:6522:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788330018.055344:0:6522:0:(import.c:65:import_set_state_nolock()) ffff99eef59fd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788330018.055443:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875199792272896:12345-0@lo:38: Request processed in 328us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330018.055451:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788330018.055603:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792273024:0@lo:400: 00000100:00100000:3.0:1788330018.055632:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330018.055652:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330018.055656:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792273408:0@lo:400: 00000100:00100000:3.0:1788330018.055688:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330018.055713:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792273152:0@lo:400: 00000100:00100000:3.0:1788330018.055732:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330018.055746:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330018.055750:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792273280:0@lo:400: 00000100:00100000:3.0:1788330018.055770:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330018.055790:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792273408 00000100:00100000:3.0:1788330018.055794:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792273408 00000100:00100000:3.0:1788330018.055834:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792273152 00000100:00100000:3.0:1788330018.055837:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792273152 00000100:00100000:3.0:1788330018.055850:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788330018.055856:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792273408:12345-0@lo:400: 00000100:00100000:3.0:1788330018.055891:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792273408:12345-0@lo:400: Request processed in 35us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330018.055897:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788330018.055909:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788330018.055915:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792273152:12345-0@lo:400: 00000100:00100000:3.0:1788330018.055938:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792273152:12345-0@lo:400: Request processed in 24us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330018.055943:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788330018.055979:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792273152:0@lo:400: 00000100:00100000:3.0:1788330018.055999:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792273408:0@lo:400: 00000100:00100000:1.0:1788330018.056258:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792273024 00000100:00100000:1.0:1788330018.056263:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792273024 00000100:00100000:1.0:1788330018.056289:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792273280 00000100:00100000:1.0:1788330018.056291:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792273280 00000100:00100000:1.0:1788330018.056309:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788330018.056314:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792273024:12345-0@lo:400: 00000100:00100000:1.0:1788330018.056357:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792273024:12345-0@lo:400: Request processed in 43us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330018.056363:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788330018.056374:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788330018.056380:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792273280:12345-0@lo:400: 00000100:00100000:1.0:1788330018.056422:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792273280:12345-0@lo:400: Request processed in 42us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330018.056428:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788330018.056457:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99eefd32d880 x1875199792273024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330018.056468:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792273024:0@lo:400: 00010000:00080000:1.0:1788330018.056485:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99eefd32c380 x1875199792273280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330018.056493:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792273280:0@lo:400: 00000020:01000004:1.0:1788330018.056673:0:8460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788330018.056690:0:8460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff99eee76c19b8) 00000020:00000080:1.0:1788330018.056717:0:8460:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1788330018.056815:0:8460:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99eefe782800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788330018.056820:0:8460:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99eefe782800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788330018.056822:0:8460:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eefe782800 3 00010000:00080000:1.0:1788330018.056849:0:8460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc5f36800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.150@tcp at head 00010000:00010000:1.0:1788330018.060771:0:8460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00010000:00080000:0.0:1788330018.061583:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99eef58cbb80 x1875199792272896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788330028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330018.061597:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788330018.061612:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788330018.061620:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788330018.061624:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788330018.061628:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc5f37000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788330018.061635:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875199792272896:0@lo:38: 00000020:00000080:1.0:1788330018.063967:0:8460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788330018.064206:0:8460:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788330018.064220:0:8460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x8475908e9fd0c89 00000100:00080000:1.0:1788330018.064230:0:8460:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788330018.064237:0:8460:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff99edc5f36800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330018.064274:0:8460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eef58cbb80 x1875199792273536/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788330018.064338:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875199792273536:0@lo:38: 00000100:00100000:0.0:1788330018.064417:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330018.066220:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792273536 00000100:00100000:1.0:1788330018.066236:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792273536 00000100:00100000:1.0:1788330018.066293:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788330018.066303:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875199792273536:12345-0@lo:38: 00010000:00080000:1.0:1788330018.066341:0:6523:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:1.0:1788330018.066400:0:6523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x8475908e9fd0c90 00000004:00100000:1.0:1788330018.066417:0:6523:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788330018.066455:0:6523:0:(import.c:65:import_set_state_nolock()) ffff99edc65ee800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788330018.073735:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875199792273536:12345-0@lo:38: Request processed in 7421us (9307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330018.073752:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788330018.073792:0:8460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1788330018.076730:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1788330018.077263:0:8431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788330018.077291:0:8431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788330018.077314:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c3a00/0x8475908e9fd0c5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0c66 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330018.077327:0:8431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef58c3a00/0x8475908e9fd0c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0c66 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788330018.077381:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788330018.077383:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788330018.077385:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788330018.077386:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788330018.077387:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788330018.077388:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788330018.077389:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788330018.077391:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788330018.077396:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788330018.077398:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788330018.077399:0:8431:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788330018.077403:0:8431:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788330018.077405:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788330018.077407:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788330018.077408:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788330018.077409:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788330018.077409:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788330018.077410:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788330018.077411:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788330018.077412:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788330018.077413:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788330018.077414:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788330018.077415:0:8431:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788330018.077442:0:8431:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788330018.077461:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792273664:0@lo:253: 00000100:00100000:2.0:1788330018.077545:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330018.077588:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec9766240 going to sleep for 11 seconds 00000100:00100000:3.0:1788330018.077904:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792273664 00000100:00100000:3.0:1788330018.077912:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792273664 00000100:00100000:3.0:1788330018.077960:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788330018.077969:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:8431:x1875199792273664:12345-0@lo:253: 20000000:01000000:3.0:1788330018.078016:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788330018.078031:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1788330018.078936:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99eef58cbb80 x1875199792273536/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788330028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330018.078949:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788330018.078957:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788330018.078965:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788330018.078970:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788330018.078974:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc5f36800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788330018.078982:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875199792273536:0@lo:38: 20000000:01000000:3.0:1788330018.086311:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788330018.086380:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788330018.086638:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:8431:x1875199792273664:12345-0@lo:253: Request processed in 8663us (9088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330018.086651:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788330018.086772:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8431:1875199792273664:0@lo:253: 10000000:01000000:0.0:1788330018.086786:0:8431:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788330018.086790:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788330018.086791:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788330018.086793:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788330018.086794:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788330018.086795:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788330018.086796:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788330018.086798:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788330018.086869:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788330018.086871:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788330018.086872:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788330018.086874:0:8431:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788330018.086890:0:8431:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788330018.089237:0:6538:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788330018.089247:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788330018.089914:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99eef59cb200/0x8475908e9fd0c97 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330018.089935:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eeef91be00/0x8475908e9fd0b8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0b86 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330018.089943:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eec0030200/0x8475908e9fd0ba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0ba2 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330018.089951:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99eef59cb200/0x8475908e9fd0c97 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330018.089993:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eec0030200/0x8475908e9fd0ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0ba2 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330018.090017:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eec0030200/0x8475908e9fd0ba9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0ba2 expref: 15 pid: 6515 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330018.090031:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875199792273792:0@lo:104: 00000100:00100000:3.0:1788330018.090137:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788330018.090439:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eeef91be00/0x8475908e9fd0b8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0b86 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330018.090447:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eeef91be00/0x8475908e9fd0b8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0b86 expref: 15 pid: 6516 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330018.090476:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875199792273920:0@lo:104: 00000100:00100000:3.0:1788330018.090498:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10880c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330018.090643:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788330018.090664:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330018.090723:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792273792 00000100:00100000:2.0:1788330018.090732:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792273792 00000100:00100000:1.0:1788330018.092573:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792273920 00000100:00100000:1.0:1788330018.092587:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792273920 00000100:00100000:1.0:1788330018.092649:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788330018.092659:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefdb43850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:6538:x1875199792273792:12345-0@lo:104: 00010000:00010000:1.0:1788330018.092677:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eeef91b000/0x8475908e9fd0ba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0ba9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330018.092775:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788330018.092782:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefdb43850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:6538:x1875199792273792:12345-0@lo:104: Request processed in 125us (2645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330018.092790:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1788330018.092902:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330018.092910:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eeef91b000/0x8475908e9fd0ba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0ba9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330018.092917:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91b000 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330018.092923:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eeef91b000/0x8475908e9fd0ba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0ba9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330018.092932:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eeef91b000/0x8475908e9fd0ba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0ba9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330018.092938:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eeef91b000/0x8475908e9fd0ba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0ba9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330018.092944:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788330018.092986:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eeef91b000/0x8475908e9fd0ba2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0ba9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330018.092993:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330018.093020:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eeef91b000/0x8475908e9fd0ba2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0ba9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330018.093028:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eeef91b000/0x8475908e9fd0ba2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0ba9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330018.093052:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330018.093053:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330018.093055:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330018.093200:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788330018.093209:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:6538:x1875199792273920:12345-0@lo:104: 00010000:00010000:1.0:1788330018.093217:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd0b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0b8d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330018.093250:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788330018.093255:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:6538:x1875199792273920:12345-0@lo:104: Request processed in 48us (2592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330018.093260:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788330018.093285:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792274048:0@lo:103: 00000100:00100000:1.0:1788330018.093322:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330018.093372:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792274048 00000100:00100000:1.0:1788330018.093377:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792274048 00010000:00010000:1.0:1788330018.093395:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eec0030200/0x8475908e9fd0ba9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0ba2 expref: 16 pid: 6515 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330018.093417:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788330018.093424:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:3649:x1875199792274048:12345-0@lo:103: 00010000:00010000:1.0:1788330018.093433:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330018.093445:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eec0030200/0x8475908e9fd0ba9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0ba2 expref: 16 pid: 6515 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330018.093456:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eec0030200/0x8475908e9fd0ba9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0ba2 expref: 16 pid: 6515 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330018.093473:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330018.093501:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:3649:x1875199792274048:12345-0@lo:103: Request processed in 78us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330018.093507:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788330018.093542:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792274048:0@lo:103: 00010000:00010000:1.0:1788330018.093585:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec0030200/0x8475908e9fd0ba9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0ba2 expref: 15 pid: 6515 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330018.093596:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875199792273792:0@lo:104: 00000100:00100000:1.0:1788330018.093605:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875199792273920:0@lo:104: 00010000:00010000:1.0:1788330018.093624:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99eef59cb200/0x8475908e9fd0c97 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330018.094360:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330018.094370:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd0b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0b8d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330018.094392:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02065000 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330018.094395:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd0b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0b8d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330018.094403:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd0b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0b8d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330018.094409:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd0b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0b8d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330018.094415:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788330018.094458:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd0b86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0b8d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330018.094465:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330018.094486:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd0b86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0b8d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330018.094493:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99ef02065000/0x8475908e9fd0b86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0b8d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330018.094510:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330018.094512:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330018.094514:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330018.094573:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792274176:0@lo:103: 00000100:00100000:1.0:1788330018.094614:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:1.0:1788330018.095337:0:8431:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788330018.095499:0:8431:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788330018.095686:0:8431:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788330018.095838:0:8431:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788330018.096422:0:8431:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788330018.096670:0:8431:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788330018.098450:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788330018.101457:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792274176 00000100:00100000:0.0:1788330018.101478:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792274176 00010000:00010000:1.0:1788330018.104396:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eeef91be00/0x8475908e9fd0b8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0b86 expref: 15 pid: 6516 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330018.105012:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788330018.105027:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:3646:x1875199792274176:12345-0@lo:103: 00010000:00010000:1.0:1788330018.105048:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330018.105054:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eeef91be00/0x8475908e9fd0b8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0b86 expref: 15 pid: 6516 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330018.105070:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eeef91be00/0x8475908e9fd0b8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0b86 expref: 15 pid: 6516 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330018.105089:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eeef91be00/0x8475908e9fd0b8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0b86 expref: 15 pid: 6516 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330018.105111:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99eef59cb200/0x8475908e9fd0c97 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330018.105119:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef59cb200/0x8475908e9fd0c97 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788330018.105135:0:6509:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015888785s 00010000:00010000:1.0:1788330018.105140:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eef59cb200/0x8475908e9fd0c97 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330018.105147:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eef59cb200/0x8475908e9fd0c97 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330018.105505:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99eef59cb200/0x8475908e9fd0c97 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330018.105514:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99eef59cb200/0x8475908e9fd0c97 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330018.105530:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330018.105535:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99eef59cb200/0x8475908e9fd0c97 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330018.105543:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99eef59cb200/0x8475908e9fd0c97 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330018.105667:0:6538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99eef59cb200/0x8475908e9fd0c97 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330018.105677:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99eef59cb200/0x8475908e9fd0c97 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330018.105723:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99eef59cb200/0x8475908e9fd0c97 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330018.105733:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef59cb200/0x8475908e9fd0c97 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330018.105748:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330018.105943:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:3646:x1875199792274176:12345-0@lo:103: Request processed in 920us (11325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330018.105953:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788330018.106027:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792274176:0@lo:103: 00002000:00080000:1.0:1788330018.115250:0:8431:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788330018.115261:0:8431:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788330018.115297:0:8431:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788330018.115365:0:8431:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788330018.115388:0:8431:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788330018.115421:0:8431:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788330018.116289:0:8431:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788330018.116519:0:8431:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788330018.715553:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788330019.411371:0:8516:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788330019.411657:0:8516:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788330019.739542:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330020.260539:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792274304:0@lo:41: 00000100:00100000:3.0:1788330020.260646:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330020.260744:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792274304 00000100:00100000:3.0:1788330020.260754:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792274304 00000100:00100000:3.0:1788330020.260817:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788330020.260829:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792274304:12345-0@lo:41: 00000004:00000024:3.0:1788330020.260879:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788330020.260940:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792274304:12345-0@lo:41: Request processed in 111us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330020.260948:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788330020.263621:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792274304:0@lo:41: 00010000:00010000:0.0:1788330020.763544:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788330021.405108:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788330021.405119:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99eef59c6800 from 30 10000000:01000000:0.0:1788330021.405125:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788330021.405213:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.405226:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.405240:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330021.405271:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792274432:0@lo:101: 00000100:00100000:0.0:1788330021.405367:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330021.405435:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788330021.407917:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792274432 00000100:00100000:0.0:1788330021.407937:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792274432 00000100:00100000:0.0:1788330021.408027:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788330021.408039:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:6519:x1875199792274432:12345-0@lo:101: 00010000:00010000:0.0:1788330021.408062:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330021.408084:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef58c2800/0x8475908e9fd0ca5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0c9e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.408123:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef58c2800/0x8475908e9fd0ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0c9e expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.408145:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef58c2800/0x8475908e9fd0ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0c9e expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.408175:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c2800, rc 0) 00000100:00100000:0.0:1788330021.408273:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:6519:x1875199792274432:12345-0@lo:101: Request processed in 236us (2906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330021.408292:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788330021.408364:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792274432:0@lo:101: 00010000:00010000:0.0:1788330021.408387:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0c9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ca5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.408396:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0c9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0ca5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330021.408490:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792274560:0@lo:501: 00000100:00100000:0.0:1788330021.408526:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330021.408562:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788330021.408577:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792274560 00000100:00100000:0.0:1788330021.408581:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792274560 00000100:00100000:0.0:1788330021.408607:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788330021.408614:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:6519:x1875199792274560:12345-0@lo:501: 00000100:00100000:0.0:1788330021.408838:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:6519:x1875199792274560:12345-0@lo:501: Request processed in 223us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330021.408844:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788330021.408875:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792274560:0@lo:501: 00000100:00100000:0.0:1788330021.408905:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792274688:0@lo:503: 00000100:00100000:0.0:1788330021.408951:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330021.408965:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788330021.408988:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792274688 00000100:00100000:0.0:1788330021.408991:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792274688 00000100:00100000:0.0:1788330021.409013:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788330021.409020:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:6519:x1875199792274688:12345-0@lo:503: 00000100:00100000:0.0:1788330021.409116:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:6519:x1875199792274688:12345-0@lo:503: Request processed in 96us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330021.409122:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788330021.409184:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792274688:0@lo:503: 00000100:00100000:0.0:1788330021.409383:0:8620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8620:1875199792274816:0@lo:502: 00000100:00100000:0.0:1788330021.409414:0:8620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330021.409430:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792274816 00000100:00100000:0.0:1788330021.409433:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792274816 00000100:00100000:0.0:1788330021.409451:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788330021.409457:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8620:x1875199792274816:12345-0@lo:502: 00000100:00100000:0.0:1788330021.409523:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8620:x1875199792274816:12345-0@lo:502: Request processed in 66us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330021.409530:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788330021.409554:0:8620:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788330021.409566:0:8620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8620:1875199792274816:0@lo:502: 00000100:00100000:0.0:1788330021.409601:0:8620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8620:1875199792274944:0@lo:502: 00000100:00100000:0.0:1788330021.409630:0:8620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330021.409645:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792274944 00000100:00100000:0.0:1788330021.409648:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792274944 00000100:00100000:0.0:1788330021.411084:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788330021.411110:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8620:x1875199792274944:12345-0@lo:502: 00000100:00100000:0.0:1788330021.411307:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:8620:x1875199792274944:12345-0@lo:502: Request processed in 208us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330021.411314:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788330021.411374:0:8620:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788330021.411409:0:8620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8620:1875199792274944:0@lo:502: 00000040:00080000:0.0:1788330021.411449:0:8620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788330021.411548:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788330021.411573:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788330021.411586:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0c9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ca5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.411598:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ca5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330021.411611:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788330021.411614:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99eef59c6800 from 5 10000000:01000000:0.0:1788330021.411630:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788330021.414246:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.414268:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.414281:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0cac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330021.414313:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792275072:0@lo:101: 00000100:00100000:0.0:1788330021.414399:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330021.414437:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788330021.414467:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792275072 00000100:00100000:0.0:1788330021.414476:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792275072 00000100:00100000:0.0:1788330021.414537:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788330021.414546:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:6519:x1875199792275072:12345-0@lo:101: 00010000:00010000:0.0:1788330021.414563:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330021.414586:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0cb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0cac expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.414612:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0cac expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.421425:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0cac expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.421440:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c3200, rc 0) 00000100:00100000:0.0:1788330021.421570:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792275072:12345-0@lo:101: Request processed in 7021us (7167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330021.421581:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788330021.424606:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792275072:0@lo:101: 00010000:00010000:1.0:1788330021.424671:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0cac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0cb3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330021.424702:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0cac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0cb3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330021.424806:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792275200:0@lo:256: 00000100:00100000:1.0:1788330021.424896:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330021.424945:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee74ff000 going to sleep for 11 seconds 00000100:00100000:1.0:1788330021.424980:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792275200 00000100:00100000:1.0:1788330021.424988:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792275200 00000100:00100000:1.0:1788330021.425055:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788330021.425066:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792275200:12345-0@lo:256: 20000000:01000000:1.0:1788330021.425093:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788330021.425113:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788330021.425117:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788330021.425244:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792275200:12345-0@lo:256: Request processed in 178us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330021.425253:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788330021.425295:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792275200:0@lo:256: 10000000:01000000:1.0:1788330021.425343:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788330021.425352:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0cac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0cb3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330021.425361:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0cb3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330021.425371:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788330021.425375:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1788330021.425378:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788330021.425411:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd0cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330021.425418:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd0cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330021.425428:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd0cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330021.425441:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792275328:0@lo:101: 00000100:00100000:1.0:1788330021.425467:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330021.425487:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee74ff000 going to sleep for 11 seconds 00000100:00100000:3.0:1788330021.425579:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792275328 00000100:00100000:3.0:1788330021.425584:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792275328 00000100:00100000:3.0:1788330021.425621:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788330021.425628:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792275328:12345-0@lo:101: 00010000:00010000:3.0:1788330021.425639:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330021.425653:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef59ca400/0x8475908e9fd0cc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0cba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330021.425677:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef59ca400/0x8475908e9fd0cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0cba expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330021.425689:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef59ca400/0x8475908e9fd0cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0cba expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330021.425711:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59ca400, rc 0) 00000100:00100000:3.0:1788330021.425745:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792275328:12345-0@lo:101: Request processed in 118us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330021.425752:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788330021.428350:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792275328:0@lo:101: 00010000:00010000:1.0:1788330021.428387:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd0cba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0cc1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330021.428401:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd0cba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0cc1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330021.428533:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792275456:0@lo:501: 00000100:00100000:1.0:1788330021.428613:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330021.429005:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee74ff000 going to sleep for 11 seconds 00000100:00100000:3.0:1788330021.429175:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792275456 00000100:00100000:3.0:1788330021.429186:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792275456 00000100:00100000:3.0:1788330021.429242:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788330021.429254:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792275456:12345-0@lo:501: 00000100:00100000:3.0:1788330021.429442:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792275456:12345-0@lo:501: Request processed in 189us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330021.429451:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788330021.429909:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792275456:0@lo:501: 00000100:00100000:1.0:1788330021.429957:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792275584:0@lo:503: 00000100:00100000:1.0:1788330021.430463:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330021.430505:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee74ff000 going to sleep for 11 seconds 00000100:00100000:3.0:1788330021.430585:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792275584 00000100:00100000:3.0:1788330021.430593:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792275584 00000100:00100000:3.0:1788330021.430657:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788330021.430675:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792275584:12345-0@lo:503: 00000100:00100000:3.0:1788330021.431041:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792275584:12345-0@lo:503: Request processed in 367us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330021.431049:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788330021.431107:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792275584:0@lo:503: 00000100:00100000:0.0:1788330021.443789:0:8621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8621:1875199792275712:0@lo:502: 00000100:00100000:0.0:1788330021.443931:0:8621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330021.444002:0:8621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec37040c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330021.444278:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792275712 00000100:00100000:1.0:1788330021.444290:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792275712 00000100:00100000:1.0:1788330021.444358:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788330021.444371:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:8621:x1875199792275712:12345-0@lo:502: 00000100:00100000:1.0:1788330021.444540:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:8621:x1875199792275712:12345-0@lo:502: Request processed in 171us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330021.444549:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788330021.444784:0:8621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8621:1875199792275712:0@lo:502: 00000020:01000000:0.0:1788330021.444825:0:8621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788330021.444835:0:8621:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788330021.444843:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330021.444846:0:8621:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788330021.444850:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788330021.444854:0:8621:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:01000000:0.0:1788330021.444886:0:8621:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788330021.444889:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788330021.444910:0:8621:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff99eef5830000) 00000020:00000080:0.0:1788330021.444934:0:8621:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788330021.444941:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788330021.445070:0:8621:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788330021.445078:0:8621:0:(osd_handler.c:8927:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788330021.445094:0:8621:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8475908e9fd0ccf 00010000:00080000:0.0:1788330021.445146:0:8621:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99eefd33a800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.150@tcp at head 00010000:00010000:0.0:1788330021.445442:0:8621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788330021.454443:0:8621:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788330021.454479:0:8621:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788330021.454959:0:8621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788330021.455889:0:8621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788330021.456015:0:8621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788330021.456112:0:8621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788330021.459547:0:8623:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788330021.459558:0:8623:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788330021.463559:0:8621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788330021.463581:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788330021.463732:0:8621:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788330021.463766:0:8621:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd0cd6 00000100:00080000:0.0:1788330021.463852:0:8621:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788330021.463861:0:8621:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99eefd33a800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:0.0:1788330021.463914:0:8621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eee7642a00 x1875199792275840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788330021.463989:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792275840:0@lo:8: 00000100:00100000:2.0:1788330021.464091:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788330021.464208:0:8621:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788330021.464280:0:8621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788330021.464285:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330021.464287:0:8621:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788330021.464290:0:8621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788330021.464294:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330021.464295:0:8621:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788330021.464298:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788330021.464300:0:8621:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788330021.464331:0:8621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8621:1875199792275968:0@lo:502: 00000100:00100000:0.0:1788330021.464384:0:8621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330021.464420:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792275968 00000100:00100000:0.0:1788330021.464428:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792275968 00000100:00100000:0.0:1788330021.464474:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788330021.464484:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:8621:x1875199792275968:12345-0@lo:502: 00000100:00100000:0.0:1788330021.464634:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:8621:x1875199792275968:12345-0@lo:502: Request processed in 150us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330021.464648:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788330021.465043:0:8621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3704600 going to sleep for 11 seconds 00000100:00100000:0.0:1788330021.465071:0:8621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8621:1875199792275968:0@lo:502: 00000020:01000000:0.0:1788330021.465102:0:8621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788330021.465107:0:8621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330021.465109:0:8621:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788330021.465113:0:8621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:2.0:1788330021.468331:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792275840 00000100:00100000:2.0:1788330021.468356:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792275840 00000100:00100000:2.0:1788330021.468466:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788330021.468477:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875199792275840:12345-0@lo:8: 00010000:00080000:2.0:1788330021.468519:0:8437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:2.0:1788330021.468561:0:8437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd0cdd 00002000:00100000:2.0:1788330021.468655:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff99edc5c6e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788330021.470001:0:8437:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1788330021.470011:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788330021.470102:0:8437:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788330021.470384:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788330021.470427:0:8437:0:(import.c:65:import_set_state_nolock()) ffff99edc5c6c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330021.470555:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875199792275840:12345-0@lo:8: Request processed in 2076us (6461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330021.470566:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:1.0:1788330021.470700:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1788330021.470741:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788330021.470756:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd0cba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0cc1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330021.470768:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd0cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0cc1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330021.471896:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788330021.471903:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99eec865b000 from 30 10000000:01000000:1.0:1788330021.471908:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788330021.471959:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0ce4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330021.471979:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0ce4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330021.471992:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0ce4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330021.472031:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792276096:0@lo:101: 00000100:00100000:1.0:1788330021.472105:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330021.472185:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee74ff9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330021.472326:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792276096 00000100:00100000:1.0:1788330021.472335:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792276096 00000100:00100000:1.0:1788330021.472395:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788330021.472406:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792276096:12345-0@lo:101: 00010000:00010000:1.0:1788330021.472421:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330021.472434:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec147ba00/0x8475908e9fd0ceb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0ce4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330021.472465:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec147ba00/0x8475908e9fd0ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0ce4 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330021.472477:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec147ba00/0x8475908e9fd0ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0ce4 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330021.472489:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147ba00, rc 0) 00000100:00100000:1.0:1788330021.472529:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792276096:12345-0@lo:101: Request processed in 124us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330021.472536:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788330021.472585:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792276096:0@lo:101: 00010000:00010000:1.0:1788330021.472602:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0ce4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ceb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330021.472612:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0ce4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0ceb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330021.472712:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792276224:0@lo:501: 00000100:00100000:1.0:1788330021.472738:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330021.472754:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee74ff9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330021.474295:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792276224 00000100:00100000:0.0:1788330021.474312:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792276224 00000100:00100000:0.0:1788330021.474366:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788330021.474378:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792276224:12345-0@lo:501: 00000100:00100000:0.0:1788330021.474601:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792276224:12345-0@lo:501: Request processed in 225us (1861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330021.474610:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788330021.475320:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792276224:0@lo:501: 00000100:00100000:0.0:1788330021.475386:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792276352:0@lo:503: 00000100:00100000:0.0:1788330021.475452:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330021.475490:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3704f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788330021.475506:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792276352 00000100:00100000:0.0:1788330021.475513:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792276352 00000100:00100000:0.0:1788330021.475545:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788330021.475553:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792276352:12345-0@lo:503: 00000100:00100000:1.0:1788330021.476533:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792276480:0@lo:400: 00000100:00100000:2.0:1788330021.476676:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792276608:0@lo:400: 00000100:00100000:3.0:1788330021.477332:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792276736:0@lo:400: 00000100:00100000:1.0:1788330021.477995:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330021.478058:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792276992:0@lo:400: 00000100:00100000:1.0:1788330021.478097:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330021.478172:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792276480 00000100:00100000:1.0:1788330021.478181:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792276480 00000100:00100000:1.0:1788330021.478235:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792276992 00000100:00100000:1.0:1788330021.478239:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792276992 00000100:00100000:1.0:1788330021.478276:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788330021.478286:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792276480:12345-0@lo:400: 00000100:00100000:1.0:1788330021.478349:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792276480:12345-0@lo:400: Request processed in 64us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330021.478357:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788330021.478375:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788330021.478382:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792276992:12345-0@lo:400: 00000100:00100000:1.0:1788330021.478410:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792276992:12345-0@lo:400: Request processed in 28us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330021.478416:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788330021.478432:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788330021.478468:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6d40e00 x1875199792276992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330021.478483:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792276992:0@lo:400: 00010000:00080000:1.0:1788330021.478510:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6d43800 x1875199792276480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330021.478519:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792276480:0@lo:400: 00000100:00100000:2.0:1788330021.479185:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330021.479230:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792277120:0@lo:400: 00000100:00100000:2.0:1788330021.479268:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330021.479301:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792276864:0@lo:400: 00000100:00100000:2.0:1788330021.479329:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330021.479362:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792277120 00000100:00100000:2.0:1788330021.479367:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792277120 00000100:00100000:2.0:1788330021.479410:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788330021.479418:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792277120:12345-0@lo:400: 00000100:00100000:2.0:1788330021.479458:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792277120:12345-0@lo:400: Request processed in 42us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330021.479474:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788330021.479496:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788330021.479518:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6d40000 x1875199792277120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330021.479528:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792277120:0@lo:400: 00010000:00080000:2.0:1788330021.479578:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eee7642a00 x1875199792275840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788330031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330021.479587:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788330021.479598:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788330021.479607:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788330021.479625:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788330021.479630:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eefd33a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788330021.479645:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788330021.479657:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792275840:0@lo:8: 00000100:00100000:1.0:1788330021.479761:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792276608 00000100:00100000:1.0:1788330021.479766:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792276608 00000100:00100000:1.0:1788330021.479801:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792276864 00000100:00100000:1.0:1788330021.479804:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792276864 00000100:00100000:1.0:1788330021.479819:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788330021.479825:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792276608:12345-0@lo:400: 00000100:00100000:1.0:1788330021.479869:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792276608:12345-0@lo:400: Request processed in 44us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330021.479875:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788330021.479887:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788330021.479893:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792276864:12345-0@lo:400: 00000100:00100000:1.0:1788330021.479923:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792276864:12345-0@lo:400: Request processed in 30us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330021.479928:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788330021.479991:0:8625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8625:1875199792277248:0@lo:700: 00000100:00100000:1.0:1788330021.480042:0:8625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330021.480071:0:8625:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee74ff780 going to sleep for 11 seconds 00000100:00100000:2.0:1788330021.480458:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792276864:0@lo:400: 00000100:00100000:2.0:1788330021.480487:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792277248 00000100:00100000:2.0:1788330021.480491:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792277248 00000100:00100000:2.0:1788330021.480530:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788330021.480538:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8625:x1875199792277248:12345-0@lo:700: 00000100:00100000:2.0:1788330021.480578:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8446:1875199792277376:0@lo:700: 00000100:00100000:2.0:1788330021.480628:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330021.480658:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788330021.480903:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792277376 00000100:00100000:2.0:1788330021.480907:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792277376 00000100:00100000:2.0:1788330021.480936:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788330021.480950:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8446:x1875199792277376:12345-0@lo:700: 00000100:00100000:2.0:1788330021.481112:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792276608:0@lo:400: 00000100:00080000:1.0:1788330021.481320:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330021.482551:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330021.482644:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792276736 00000100:00100000:3.0:1788330021.482764:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792276736 00000100:00100000:3.0:1788330021.482896:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788330021.482908:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792276736:12345-0@lo:400: 00000100:00100000:3.0:1788330021.482997:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792276736:12345-0@lo:400: Request processed in 91us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330021.483006:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788330021.483057:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6d40380 x1875199792276736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330021.483071:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792276736:0@lo:400: 00000004:00080000:3.0:1788330021.483115:0:8623:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788330021.483431:0:8623:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 225455279527ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788330021.483439:0:8623:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788330021.483549:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792276352:12345-0@lo:503: Request processed in 7993us (8095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330021.483560:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788330021.483813:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792276352:0@lo:503: 00000100:00100000:2.0:1788330021.484443:0:8626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8626:1875199792277504:0@lo:502: 00000100:00100000:2.0:1788330021.484513:0:8626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330021.484557:0:8626:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788330021.484600:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792277504 00000100:00100000:0.0:1788330021.484614:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792277504 00000100:00100000:0.0:1788330021.484683:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788330021.484693:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:8626:x1875199792277504:12345-0@lo:502: 00000100:00100000:0.0:1788330021.485042:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:8626:x1875199792277504:12345-0@lo:502: Request processed in 350us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330021.485050:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788330021.485104:0:8626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8626:1875199792277504:0@lo:502: 00000100:00100000:0.0:1788330021.485227:0:8626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7643480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8626:1875199792277632:0@lo:502: 00000100:00100000:0.0:1788330021.485267:0:8626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330021.485293:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792277632 00000100:00100000:0.0:1788330021.485297:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792277632 00000100:00100000:0.0:1788330021.485321:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788330021.485328:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:8626:x1875199792277632:12345-0@lo:502: 00000100:00100000:0.0:1788330021.485387:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:8626:x1875199792277632:12345-0@lo:502: Request processed in 59us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330021.485394:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788330021.485419:0:8626:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec37043c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330021.485430:0:8626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7643480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8626:1875199792277632:0@lo:502: 00000040:00080000:0.0:1788330021.485446:0:8626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788330021.485506:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788330021.485532:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788330021.485544:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0ce4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ceb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.485556:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ceb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330021.485577:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788330021.485580:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99eec865b000 from 5 10000000:01000000:0.0:1788330021.485583:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788330021.485609:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c3400/0x8475908e9fd0cf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.485618:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef58c3400/0x8475908e9fd0cf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.485628:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef58c3400/0x8475908e9fd0cf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330021.485639:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7643480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792277760:0@lo:101: 00000100:00100000:0.0:1788330021.485922:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330021.485939:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec37043c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330021.485954:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792277760 00000100:00100000:0.0:1788330021.485957:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792277760 00000100:00100000:0.0:1788330021.485993:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788330021.486001:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792277760:12345-0@lo:101: 00010000:00010000:0.0:1788330021.486012:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330021.486027:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef58c3c00/0x8475908e9fd0cf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0cf2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.486054:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef58c3c00/0x8475908e9fd0cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0cf2 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.486063:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef58c3c00/0x8475908e9fd0cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0cf2 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.486084:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c3c00, rc 0) 00000100:00100000:0.0:1788330021.486113:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:6519:x1875199792277760:12345-0@lo:101: Request processed in 114us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330021.486118:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788330021.486195:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7643480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792277760:0@lo:101: 00010000:00010000:0.0:1788330021.486208:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef58c3400/0x8475908e9fd0cf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0cf9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.486217:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef58c3400/0x8475908e9fd0cf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0cf9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330021.486269:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7643480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792277888:0@lo:256: 00000100:00100000:0.0:1788330021.486302:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330021.486316:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec37043c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330021.486327:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792277888 00000100:00100000:0.0:1788330021.486331:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792277888 00000100:00100000:0.0:1788330021.486353:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788330021.486359:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:6519:x1875199792277888:12345-0@lo:256: 20000000:01000000:0.0:1788330021.486373:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788330021.486391:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788330021.486394:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788330021.486470:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:6519:x1875199792277888:12345-0@lo:256: Request processed in 110us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330021.486476:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788330021.486506:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7643480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792277888:0@lo:256: 10000000:01000000:0.0:1788330021.486551:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788330021.486560:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c3400/0x8475908e9fd0cf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0cf9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.486568:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef58c3400/0x8475908e9fd0cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0cf9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330021.486576:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788330021.486578:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788330021.486580:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788330021.486595:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0d00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.486603:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0d00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330021.486610:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0d00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330021.486621:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7643480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792278016:0@lo:101: 00000100:00100000:0.0:1788330021.487404:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330021.487474:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec37043c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330021.493499:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792278016 00000100:00100000:2.0:1788330021.493518:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792278016 00000100:00100000:2.0:1788330021.493598:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788330021.493623:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:6519:x1875199792278016:12345-0@lo:101: 00010000:00010000:2.0:1788330021.493654:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330021.493865:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ef02064200/0x8475908e9fd0d07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0d00 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788330021.493896:0:7454:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00010000:2.0:1788330021.493907:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ef02064200/0x8475908e9fd0d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0d00 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330021.493923:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ef02064200/0x8475908e9fd0d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0d00 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330021.493936:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ef02064200, rc 0) 00000100:00100000:2.0:1788330021.494068:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792278016:12345-0@lo:101: Request processed in 459us (6666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330021.494077:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788330021.494219:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7643480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792278016:0@lo:101: 00010000:00010000:1.0:1788330021.494247:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0d00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0d07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330021.494262:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0d00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0d07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330021.494382:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792278144:0@lo:501: 00000100:00100000:1.0:1788330021.494446:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330021.494506:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee74ff6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330021.494514:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792278144 00000100:00100000:2.0:1788330021.494524:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792278144 00000100:00100000:2.0:1788330021.494560:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788330021.494581:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792278144:12345-0@lo:501: 00000100:00100000:2.0:1788330021.494959:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792278144:12345-0@lo:501: Request processed in 379us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330021.494978:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788330021.495035:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792278144:0@lo:501: 00000100:00100000:2.0:1788330021.495086:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792278272:0@lo:503: 00000100:00100000:2.0:1788330021.495881:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330021.495921:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 11 seconds 40000000:02000000:2.0:1788330021.495956:0:6529:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1788330021.497208:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792278272 00000100:00100000:1.0:1788330021.497224:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792278272 00000100:00100000:1.0:1788330021.497294:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788330021.497306:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792278272:12345-0@lo:503: 00000100:00100000:1.0:1788330021.497494:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792278272:12345-0@lo:503: Request processed in 189us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330021.497503:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788330021.498279:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792278272:0@lo:503: 00000100:00100000:3.0:1788330021.499991:0:8628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8628:1875199792278400:0@lo:502: 00000100:00100000:3.0:1788330021.501291:0:8628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330021.501352:0:8628:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec2af9900 going to sleep for 11 seconds 00000100:00100000:3.0:1788330021.501398:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792278400 00000100:00100000:3.0:1788330021.501407:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792278400 00000100:00100000:3.0:1788330021.501471:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788330021.501483:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:8628:x1875199792278400:12345-0@lo:502: 00000100:00100000:3.0:1788330021.502865:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:8628:x1875199792278400:12345-0@lo:502: Request processed in 1378us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330021.502879:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788330021.502985:0:8628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8628:1875199792278400:0@lo:502: 00000020:01000000:3.0:1788330021.503033:0:8628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788330021.503044:0:8628:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788330021.503054:0:8628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330021.503057:0:8628:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788330021.503062:0:8628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788330021.503073:0:8628:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:01000000:3.0:1788330021.503105:0:8628:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788330021.503108:0:8628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788330021.504500:0:8628:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99eeffc499b8) 00000020:00000080:3.0:1788330021.504541:0:8628:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788330021.504559:0:8628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788330021.504950:0:8628:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788330021.504958:0:8628:0:(osd_handler.c:8927:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788330021.504978:0:8628:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd0d15 00010000:00080000:3.0:1788330021.505859:0:8628:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc6559800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.150@tcp at head 00010000:00010000:1.0:1788330021.507017:0:8628:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:3.0:1788330021.520811:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8446:x1875199792277376:12345-0@lo:700: Request processed in 39848us (40168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330021.520838:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788330021.534315:0:8446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6d41880 x1875199792277376/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788330037 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330021.534343:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8446:1875199792277376:0@lo:700: 40000000:02000000:2.0:1788330021.534362:0:8446:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:1.0:1788330021.537475:0:8628:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788330021.537510:0:8628:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788330021.537770:0:8628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788330021.538214:0:8628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788330021.538315:0:8628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788330021.538408:0:8628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788330021.539639:0:8630:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788330021.539646:0:8630:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788330021.555719:0:8628:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788330021.555735:0:8628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788330021.555784:0:8628:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788330021.555814:0:8628:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd0d1c 00000100:00080000:1.0:1788330021.555825:0:8628:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788330021.555831:0:8628:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99edc6559800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330021.555872:0:8628:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eef6ea0000 x1875199792278528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788330021.556063:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792278528:0@lo:8: 00000100:00100000:0.0:1788330021.556193:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788330021.556613:0:8628:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788330021.556693:0:8628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330021.556698:0:8628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330021.556701:0:8628:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788330021.556704:0:8628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330021.556708:0:8628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330021.556710:0:8628:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788330021.556714:0:8628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788330021.556716:0:8628:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788330021.556753:0:8628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8628:1875199792278656:0@lo:502: 00000100:00100000:1.0:1788330021.556849:0:8628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330021.556902:0:8628:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeccff7900 going to sleep for 11 seconds 00000100:00100000:3.0:1788330021.559296:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792278656 00000100:00100000:3.0:1788330021.559315:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792278656 00000100:00100000:3.0:1788330021.559385:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788330021.559397:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:8628:x1875199792278656:12345-0@lo:502: 00000100:00100000:3.0:1788330021.559612:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:8628:x1875199792278656:12345-0@lo:502: Request processed in 217us (2762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330021.560764:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788330021.560922:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792278528 00000100:00100000:0.0:1788330021.560931:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792278528 00000100:00100000:0.0:1788330021.560977:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788330021.560987:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1875199792278528:12345-0@lo:8: 00010000:00080000:0.0:1788330021.561248:0:8440:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:0.0:1788330021.561290:0:8440:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd0d23 00002000:00100000:0.0:1788330021.561317:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99eedfe6b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788330021.561322:0:8440:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788330021.561326:0:8440:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788330021.561434:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788330021.561471:0:8440:0:(import.c:65:import_set_state_nolock()) ffff99eedfe6d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330021.561571:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875199792278528:12345-0@lo:8: Request processed in 582us (5376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330021.561579:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788330021.561895:0:8628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:8628:1875199792278656:0@lo:502: 00000020:01000000:3.0:1788330021.561945:0:8628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330021.561953:0:8628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330021.561956:0:8628:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788330021.561961:0:8628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788330021.567183:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788330021.567229:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788330021.567243:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0d00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0d07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330021.567259:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0d00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0d07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330021.567273:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788330021.567276:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99eee7570000 from 1 10000000:01000000:1.0:1788330021.567279:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788330021.567325:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0d2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330021.567334:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0d2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330021.567345:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0d2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330021.567391:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792278784:0@lo:101: 00000100:00100000:1.0:1788330021.567461:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330021.567523:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eecaf9aa80 going to sleep for 11 seconds 00010000:00080000:0.0:1788330021.568237:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6ea0000 x1875199792278528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788330031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330021.568256:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788330021.568271:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788330021.568291:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788330021.568302:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788330021.568308:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc6559800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788330021.568329:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788330021.568338:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792278528:0@lo:8: 00000004:00080000:0.0:1788330021.568483:0:8630:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000001:00100000:1.0:1788330021.572698:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788330021.573032:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8625:x1875199792277248:12345-0@lo:700: Request processed in 92488us (92983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330021.573047:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788330021.573119:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792278784 00000100:00100000:3.0:1788330021.573167:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792278784 00010000:00080000:1.0:1788330021.573209:0:8625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef58cad80 x1875199792277248/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788330037 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330021.573227:0:8625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8625:1875199792277248:0@lo:700: 00000100:00100000:3.0:1788330021.573247:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788330021.573262:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792278784:12345-0@lo:101: 00010000:00010000:3.0:1788330021.573298:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330021.573325:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef59ca600/0x8475908e9fd0d31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0d2a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330021.573365:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef59ca600/0x8475908e9fd0d31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0d2a expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330021.573377:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef59ca600/0x8475908e9fd0d31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0d2a expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330021.573388:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59ca600, rc 0) 00000100:00100000:3.0:1788330021.573474:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792278784:12345-0@lo:101: Request processed in 216us (6014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330021.573481:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788330021.573516:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792278784:0@lo:101: 00010000:00010000:1.0:1788330021.573542:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0d2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0d31 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330021.573555:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0d2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0d31 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330021.573625:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792278912:0@lo:501: 00000100:00100000:1.0:1788330021.573663:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330021.573703:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eecaf9aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330021.573913:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792278912 00000100:00100000:2.0:1788330021.573919:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792278912 00000100:00100000:2.0:1788330021.573978:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788330021.573986:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792278912:12345-0@lo:501: 00000100:00100000:2.0:1788330021.574065:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792278912:12345-0@lo:501: Request processed in 79us (401us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788330021.574071:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788330021.574318:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792278912:0@lo:501: 10000000:01000000:1.0:1788330021.574367:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788330021.574375:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0d2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0d31 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330021.574385:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0d2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0d31 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788330021.574563:0:8630:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 225546410462ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788330021.574572:0:8630:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788330021.577377:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330021.577409:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792279040:0@lo:13: 00000100:00100000:1.0:1788330021.577486:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788330021.580226:0:8631:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788330021.580322:0:8631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8631:1875199792279168:0@lo:7: 00000100:00100000:2.0:1788330021.580401:0:8631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330021.580449:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792279168 00000100:00100000:2.0:1788330021.580457:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792279168 00000004:00080000:3.0:1788330021.581394:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788330021.582055:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792279040 00000100:00100000:0.0:1788330021.582071:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792279040 00000100:00080000:1.0:1788330021.582109:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788330021.582207:0:8625:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788330021.582233:0:8625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8625:1875199792279424:0@lo:7: 00000100:00100000:1.0:1788330021.582284:0:8625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330021.582536:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330021.582560:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792279296:0@lo:13: 00000100:00100000:0.0:1788330021.583456:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788330021.583482:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875199792279040:12345-0@lo:13: 00002000:00000024:0.0:1788330021.583530:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1788330021.584381:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875199792279040:12345-0@lo:13: Request processed in 906us (6889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330021.584393:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788330021.586217:0:8625:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eecaf9aa80 going to sleep for 11 seconds 00010000:00080000:1.0:1788330021.586285:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6ea2300 x1875199792279040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330021.586314:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792279040:0@lo:13: 00000100:00100000:2.0:1788330021.586822:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792279424 00000100:00100000:2.0:1788330021.586832:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792279424 00000100:00100000:2.0:1788330021.586883:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788330021.586894:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8631:x1875199792279168:12345-0@lo:7: 00000100:00100000:3.0:1788330021.587327:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330021.588325:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792279296 00000100:00100000:0.0:1788330021.588351:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792279296 00000100:00100000:0.0:1788330021.588419:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788330021.588436:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875199792279296:12345-0@lo:13: 00002000:00000024:0.0:1788330021.588466:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1788330021.589286:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875199792279296:12345-0@lo:13: Request processed in 854us (1963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330021.589299:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788330021.589417:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6ea2d80 x1875199792279296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330021.589446:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792279296:0@lo:13: 00000100:00100000:3.0:1788330021.595426:0:8631:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e300 going to sleep for 11 seconds 00002000:00080000:0.0:1788330021.600125:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788330021.600301:0:8437:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788330021.600514:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8631:x1875199792279168:12345-0@lo:7: Request processed in 13614us (20105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330021.600530:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788330021.600586:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788330021.600603:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8625:x1875199792279424:12345-0@lo:7: 00010000:00080000:3.0:1788330021.605224:0:8631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6d41880 x1875199792279168/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788330037 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330021.605249:0:8631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8631:1875199792279168:0@lo:7: 00000004:00080000:3.0:1788330021.605271:0:8631:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788330021.605350:0:8631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8631:1875199792279552:0@lo:5: 00000100:00100000:3.0:1788330021.605436:0:8631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330021.605479:0:8631:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec2af9840 going to sleep for 11 seconds 00000100:00100000:2.0:1788330021.607263:0:8440:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788330021.607277:0:8440:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788330021.610042:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792279552 00000100:00100000:2.0:1788330021.610063:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792279552 00002000:00080000:0.0:1788330021.610961:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788330021.610983:0:8437:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788330021.611363:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8625:x1875199792279424:12345-0@lo:7: Request processed in 10756us (29067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330021.611379:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788330021.611467:0:8625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6ea1180 x1875199792279424/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788330037 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330021.611490:0:8625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8625:1875199792279424:0@lo:7: 00000004:00080000:0.0:1788330021.611513:0:8625:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788330021.611581:0:8625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8625:1875199792279680:0@lo:5: 00000100:00100000:0.0:1788330021.612220:0:8625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330021.612287:0:8625:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3704cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330021.612677:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792279680 00000100:00100000:2.0:1788330021.612689:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792279680 00000100:00100000:2.0:1788330021.612758:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788330021.612771:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7643480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8625:x1875199792279680:12345-0@lo:5: 00002000:00080000:2.0:1788330021.612953:0:8439:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788330021.613123:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7643480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8625:x1875199792279680:12345-0@lo:5: Request processed in 353us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330021.613133:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788330021.613289:0:8625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eee7642300 x1875199792279680/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788330037 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330021.613311:0:8625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8625:1875199792279680:0@lo:5: 00000004:00080000:1.0:1788330021.613328:0:8625:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788330021.613388:0:8625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8625:1875199792279808:0@lo:5: 00000100:00100000:1.0:1788330021.613455:0:8625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330021.613495:0:8625:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eecaf9aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330021.613879:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792279808 00000100:00100000:2.0:1788330021.613887:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792279808 00000100:00100000:2.0:1788330021.613918:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788330021.613926:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8625:x1875199792279808:12345-0@lo:5: 00002000:00080000:2.0:1788330021.613960:0:8439:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788330021.614264:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788330021.614273:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8631:x1875199792279552:12345-0@lo:5: 00002000:00080000:3.0:1788330021.614294:0:8632:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788330021.614296:0:8632:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788330021.623536:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8625:x1875199792279808:12345-0@lo:5: Request processed in 9598us (10068us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788330021.623567:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788330021.624495:0:8625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6ea2300 x1875199792279808/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788330037 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330021.624521:0:8625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8625:1875199792279808:0@lo:5: 00000004:00080000:3.0:1788330021.624542:0:8625:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1788330021.624608:0:8625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8625:1875199792279936:0@lo:900: 00000100:00100000:3.0:1788330021.624891:0:8625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330021.624943:0:8625:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec2af9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788330021.625296:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792279936 00000100:00100000:1.0:1788330021.625313:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792279936 00000100:00100000:1.0:1788330021.625396:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788330021.625411:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8625:x1875199792279936:12345-0@lo:900: 00000100:00100000:1.0:1788330021.625529:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8625:x1875199792279936:12345-0@lo:900: Request processed in 121us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330021.625556:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788330021.625619:0:8625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eefd32c380 x1875199792279936/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788330037 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330021.625636:0:8625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8625:1875199792279936:0@lo:900: 00000001:00080000:1.0:1788330021.633639:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:1.0:1788330021.633736:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788330021.633760:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788330021.634509:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8631:x1875199792279552:12345-0@lo:5: Request processed in 20226us (29062us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788330021.634527:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788330021.635374:0:8631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eefd32df80 x1875199792279552/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788330037 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330021.635392:0:8631:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788330021.635400:0:8631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8631:1875199792279552:0@lo:5: 00000004:00080000:0.0:1788330021.635420:0:8631:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788330021.635493:0:8631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8631:1875199792280064:0@lo:700: 00000100:00100000:0.0:1788330021.635572:0:8631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330021.635633:0:8631:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7333f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788330021.635859:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792280064 00000100:00100000:2.0:1788330021.635878:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792280064 00000100:00100000:2.0:1788330021.635955:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788330021.635983:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8631:x1875199792280064:12345-0@lo:700: 00000100:00100000:2.0:1788330021.666628:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8631:x1875199792280064:12345-0@lo:700: Request processed in 30635us (31028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330021.666658:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788330021.667234:0:8631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eee7640a80 x1875199792280064/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788330037 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330021.667255:0:8631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8631:1875199792280064:0@lo:700: 00000004:02000040:0.0:1788330021.671121:0:8631:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1788330021.676540:0:8631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8631:1875199792280192:0@lo:5: 00000100:00100000:0.0:1788330021.676658:0:8631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330021.676746:0:8631:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7333f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788330021.677478:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792280192 00000100:00100000:3.0:1788330021.677490:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792280192 00000100:00100000:3.0:1788330021.677557:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788330021.677571:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8631:x1875199792280192:12345-0@lo:5: 00002000:00080000:3.0:1788330021.688506:0:8440:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788330021.688539:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1788330021.690853:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8631:x1875199792280192:12345-0@lo:5: Request processed in 13275us (14185us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788330021.690885:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788330021.696042:0:8631:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eee7640a80 x1875199792280192/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788330037 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330021.696071:0:8631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8631:1875199792280192:0@lo:5: 00000004:00080000:1.0:1788330021.696090:0:8631:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:3.0:1788330021.787576:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330022.811468:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792280320:0@lo:41: 00000100:00100000:0.0:1788330022.811587:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330022.811764:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792280320 00000100:00100000:2.0:1788330022.811775:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792280320 00000100:00100000:2.0:1788330022.811844:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788330022.811877:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792280320:12345-0@lo:41: 00000004:00000024:2.0:1788330022.811922:0:7831:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788330022.812545:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792280320:12345-0@lo:41: Request processed in 669us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330022.812555:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788330022.812688:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792280320:0@lo:41: 00010000:00010000:3.0:1788330022.815476:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330023.846860:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330024.859517:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788330025.120324:0:8815:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788330025.372359:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792280448:0@lo:41: 00000100:00100000:3.0:1788330025.372463:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330025.374480:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792280448 00000100:00100000:2.0:1788330025.374499:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792280448 00000100:00100000:2.0:1788330025.374573:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788330025.374586:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792280448:12345-0@lo:41: 00000004:00000024:2.0:1788330025.374637:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788330025.374757:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792280448:12345-0@lo:41: Request processed in 172us (2293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330025.374765:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788330025.375503:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792280448:0@lo:41: 00010000:00010000:3.0:1788330025.884302:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788330026.114758:0:8867:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788330026.115512:0:8867:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788330026.907393:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788330026.907428:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792280576:0@lo:13: 00000100:00100000:0.0:1788330026.907519:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330026.907612:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792280576 00000100:00100000:0.0:1788330026.907623:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792280576 00000100:00100000:0.0:1788330026.907695:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788330026.907707:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792280576:12345-0@lo:13: 00002000:00000024:0.0:1788330026.907747:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330026.907800:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792280576:12345-0@lo:13: Request processed in 95us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330026.907807:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788330026.907832:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788330026.907871:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6fe7800 x1875199792280576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330026.907883:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788330026.907909:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792280576:0@lo:13: 00010000:00010000:0.0:1788330026.909132:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330026.909228:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792280704:0@lo:400: 00000100:00100000:0.0:1788330026.909322:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330026.909370:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792281216:0@lo:400: 00000100:00100000:0.0:1788330026.909395:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330026.909417:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788330026.909421:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792281088:0@lo:400: 00000100:00100000:0.0:1788330026.909442:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330026.909456:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792281600:0@lo:400: 00000100:00100000:0.0:1788330026.909473:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330026.909500:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792281216 00000100:00100000:0.0:1788330026.909510:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792281216 00000100:00100000:0.0:1788330026.909556:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788330026.909564:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792281216:12345-0@lo:400: 00000100:00100000:0.0:1788330026.909644:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792281216:12345-0@lo:400: Request processed in 79us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330026.909653:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788330026.909677:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792281088 00000100:00100000:0.0:1788330026.909680:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792281088 00000100:00100000:0.0:1788330026.909702:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788330026.909706:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792281088:12345-0@lo:400: 00000100:00100000:0.0:1788330026.909727:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792281088:12345-0@lo:400: Request processed in 21us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330026.909732:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788330026.909770:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6d40380 x1875199792281088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330026.909786:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792281088:0@lo:400: 00000100:00100000:0.0:1788330026.909799:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792281216:0@lo:400: 00000100:00100000:0.0:1788330026.909838:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792280832:0@lo:400: 00000100:00100000:0.0:1788330026.909858:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330026.909870:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792281344:0@lo:400: 00000100:00100000:0.0:1788330026.909880:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330026.909893:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788330026.909897:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792280960:0@lo:400: 00000100:00100000:0.0:1788330026.909909:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330026.909935:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792281472:0@lo:400: 00000100:00100000:0.0:1788330026.909957:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330026.909978:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792280832 00000100:00100000:0.0:1788330026.909981:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792280832 00000100:00100000:0.0:1788330026.910008:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792281344 00000100:00100000:0.0:1788330026.910011:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792281344 00000100:00100000:0.0:1788330026.910034:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792281472 00000100:00100000:0.0:1788330026.910037:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792281472 00000100:00100000:0.0:1788330026.910053:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788330026.910059:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792280832:12345-0@lo:400: 00000100:00100000:0.0:1788330026.910099:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792280832:12345-0@lo:400: Request processed in 40us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330026.910106:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788330026.910124:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788330026.910130:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792281344:12345-0@lo:400: 00000100:00100000:0.0:1788330026.910184:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792281344:12345-0@lo:400: Request processed in 54us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330026.910190:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788330026.910201:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788330026.910207:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792281472:12345-0@lo:400: 00000100:00100000:0.0:1788330026.910234:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792281472:12345-0@lo:400: Request processed in 28us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330026.910239:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788330026.910257:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788330026.910261:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788330026.910277:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eed82d3800 x1875199792281472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330026.910287:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792281472:0@lo:400: 00010000:00080000:0.0:1788330026.910298:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6d40a80 x1875199792280832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330026.910305:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792280832:0@lo:400: 00010000:00080000:0.0:1788330026.910323:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6d40e00 x1875199792281344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330026.910330:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792281344:0@lo:400: 00000100:00100000:0.0:1788330026.910378:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792281600 00000100:00100000:0.0:1788330026.910382:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792281600 00000100:00100000:0.0:1788330026.910416:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788330026.910422:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875199792281600:12345-0@lo:400: 00000100:00100000:0.0:1788330026.910460:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875199792281600:12345-0@lo:400: Request processed in 38us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330026.910467:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788330026.910479:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788330026.910495:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eed82d1180 x1875199792281600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330026.910505:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792281600:0@lo:400: 00000100:00100000:2.0:1788330026.910806:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792280960 00000100:00100000:2.0:1788330026.910812:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792280960 00000100:00100000:2.0:1788330026.910839:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788330026.910846:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792280960:12345-0@lo:400: 00000100:00100000:2.0:1788330026.910892:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792280960:12345-0@lo:400: Request processed in 46us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330026.910893:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792280704 00000100:00100000:3.0:1788330026.910898:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792280704 00000100:00100000:2.0:1788330026.910898:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788330026.910938:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792280960:0@lo:400: 00000100:00100000:3.0:1788330026.910942:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788330026.910949:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:3647:x1875199792280704:12345-0@lo:400: 00000100:00100000:3.0:1788330026.911205:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:3647:x1875199792280704:12345-0@lo:400: Request processed in 255us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330026.911212:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788330026.911663:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330026.911679:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792281728:0@lo:13: 00000100:00100000:1.0:1788330026.911724:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330026.911827:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792281728 00000100:00100000:2.0:1788330026.911834:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792281728 00000100:00100000:2.0:1788330026.911878:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788330026.911887:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792281728:12345-0@lo:13: 00002000:00000024:2.0:1788330026.911907:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330026.911962:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792281728:12345-0@lo:13: Request processed in 76us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330026.911968:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788330026.912000:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eed82d2680 x1875199792281728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330026.912015:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792281728:0@lo:13: 00000100:00100000:0.0:1788330026.912870:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792280704:0@lo:400: 00000001:00080000:1.0:1788330026.918375:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:1.0:1788330027.931505:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330027.933424:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792281856:0@lo:41: 00000100:00100000:2.0:1788330027.933532:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330027.933597:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792281856 00000100:00100000:3.0:1788330027.933608:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792281856 00000100:00100000:3.0:1788330027.933796:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788330027.933810:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792281856:12345-0@lo:41: 00000004:00000024:3.0:1788330027.934092:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788330027.934189:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792281856:12345-0@lo:41: Request processed in 382us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330027.934197:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788330027.935838:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792281856:0@lo:41: 00010000:00010000:3.0:1788330028.962688:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788330029.383710:0:8968:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788330029.383946:0:8968:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788330029.982079:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330030.499325:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330030.499360:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792281984:0@lo:41: 00000100:00100000:3.0:1788330030.499480:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330030.499577:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792281984 00000100:00100000:3.0:1788330030.499588:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792281984 00000100:00100000:3.0:1788330030.499653:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788330030.499665:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792281984:12345-0@lo:41: 00000004:00000024:3.0:1788330030.499716:0:7831:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788330030.499770:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792281984:12345-0@lo:41: Request processed in 107us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330030.499778:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788330030.499838:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792281984:0@lo:41: 00000020:00000004:2.0:1788330030.569680:0:9017:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788330030.569708:0:9017:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1788330031.005498:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330032.028632:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788330032.028670:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792282112:0@lo:13: 00010000:00010000:2.0:1788330032.028989:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330032.029237:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330032.029316:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792282240:0@lo:13: 00000100:00100000:0.0:1788330032.029346:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330032.029468:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792282112 00000100:00100000:0.0:1788330032.029479:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792282112 00000100:00100000:0.0:1788330032.029540:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792282240 00000100:00100000:0.0:1788330032.029544:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792282240 00000100:00100000:0.0:1788330032.029568:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788330032.029603:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792282112:12345-0@lo:13: 00002000:00000024:0.0:1788330032.029649:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330032.029697:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792282112:12345-0@lo:13: Request processed in 97us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330032.029705:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788330032.029924:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792282624:0@lo:400: 00000100:00100000:3.0:1788330032.029968:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330032.029993:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792283136:0@lo:400: 00000100:00100000:3.0:1788330032.030030:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330032.031264:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330032.031281:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792282752:0@lo:400: 00000100:00100000:3.0:1788330032.031337:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330032.031373:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792282624 00000100:00100000:3.0:1788330032.031382:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792282624 00000100:00100000:3.0:1788330032.031430:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788330032.031440:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792282624:12345-0@lo:400: 00000100:00100000:3.0:1788330032.031506:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792282624:12345-0@lo:400: Request processed in 66us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330032.031514:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788330032.031544:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792283136 00000100:00100000:3.0:1788330032.031549:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792283136 00000100:00100000:3.0:1788330032.031582:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792282752 00000100:00100000:3.0:1788330032.031585:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792282752 00000100:00100000:3.0:1788330032.031601:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788330032.031607:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792283136:12345-0@lo:400: 00000100:00100000:3.0:1788330032.031637:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792283136:12345-0@lo:400: Request processed in 31us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330032.031644:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788330032.031654:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788330032.031659:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792282752:12345-0@lo:400: 00000100:00100000:3.0:1788330032.031683:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792282752:12345-0@lo:400: Request processed in 24us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330032.031697:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788330032.031762:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6fe7480 x1875199792282752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330032.031780:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792282752:0@lo:400: 00000100:00100000:3.0:1788330032.031797:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792282624:0@lo:400: 00010000:00080000:3.0:1788330032.031808:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6fe4000 x1875199792283136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330032.031817:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792283136:0@lo:400: 00000100:00100000:2.0:1788330032.032117:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788330032.032135:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792282240:12345-0@lo:13: 00002000:00000024:2.0:1788330032.032280:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330032.032331:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792282240:12345-0@lo:13: Request processed in 203us (2984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330032.032338:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788330032.033806:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792282368:0@lo:400: 00000100:00100000:0.0:1788330032.033916:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330032.033979:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792282880:0@lo:400: 00000100:00100000:0.0:1788330032.034011:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330032.034419:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788330032.034429:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792282496:0@lo:400: 00000100:00100000:0.0:1788330032.034459:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330032.034479:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792283008:0@lo:400: 00000100:00100000:0.0:1788330032.034501:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788330032.034565:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eed82d0700 x1875199792282240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330032.034589:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788330032.034617:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792282240:0@lo:13: 00010000:00080000:0.0:1788330032.034632:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6fe4700 x1875199792282112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330032.034645:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792282112:0@lo:13: 00000100:00080000:0.0:1788330032.034669:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788330032.034677:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330032.034691:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792282496 00000100:00100000:0.0:1788330032.034698:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792282496 00000100:00100000:2.0:1788330032.036010:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792282368 00000100:00100000:2.0:1788330032.036027:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792282368 00000100:00100000:2.0:1788330032.036205:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788330032.036221:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:3648:x1875199792282368:12345-0@lo:400: 00000100:00100000:0.0:1788330032.036696:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792283008 00000100:00100000:0.0:1788330032.036702:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792283008 00000100:00100000:0.0:1788330032.036740:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788330032.036750:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792282496:12345-0@lo:400: 00000100:00100000:0.0:1788330032.036839:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792282496:12345-0@lo:400: Request processed in 92us (2379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330032.036848:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788330032.036879:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788330032.036887:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792283008:12345-0@lo:400: 00000100:00100000:0.0:1788330032.036927:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792283008:12345-0@lo:400: Request processed in 41us (2424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330032.036933:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788330032.036959:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792282880 00000100:00100000:0.0:1788330032.036963:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792282880 00000100:00100000:0.0:1788330032.036990:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788330032.036997:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792282880:12345-0@lo:400: 00000100:00100000:2.0:1788330032.037137:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:3648:x1875199792282368:12345-0@lo:400: Request processed in 920us (3220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330032.037145:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788330032.038110:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792282880:12345-0@lo:400: Request processed in 910us (3894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330032.038121:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788330032.038671:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788330032.038988:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6fe5f80 x1875199792282496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330032.039008:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792282496:0@lo:400: 00010000:00080000:2.0:1788330032.039024:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6fe7100 x1875199792283008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330032.039233:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792283008:0@lo:400: 00000100:00100000:2.0:1788330032.039250:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792282368:0@lo:400: 00000100:00100000:2.0:1788330032.039264:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792282880:0@lo:400: 00000100:00100000:3.0:1788330033.054626:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1788330033.055205:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330033.063956:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792283264:0@lo:41: 00000100:00100000:3.0:1788330033.064068:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330033.064247:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792283264 00000100:00100000:0.0:1788330033.064259:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792283264 00000100:00100000:0.0:1788330033.064324:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788330033.064335:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792283264:12345-0@lo:41: 00000004:00000024:0.0:1788330033.064383:0:7831:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788330033.064438:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792283264:12345-0@lo:41: Request processed in 105us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330033.064446:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788330033.064557:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792283264:0@lo:41: 00010000:00010000:2.0:1788330034.075800:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330035.104460:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330035.614944:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792283392:0@lo:41: 00000100:00100000:1.0:1788330035.615043:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330035.615133:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792283392 00000100:00100000:1.0:1788330035.615143:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792283392 00000100:00100000:1.0:1788330035.615219:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788330035.615237:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792283392:12345-0@lo:41: 00000004:00000024:1.0:1788330035.615286:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788330035.615337:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792283392:12345-0@lo:41: Request processed in 102us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330035.615345:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788330035.615404:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792283392:0@lo:41: 00010000:00010000:2.0:1788330036.124310:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330037.154391:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792283520:0@lo:13: 00000100:00100000:0.0:1788330037.154488:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330037.154551:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792284032:0@lo:400: 00000100:00100000:0.0:1788330037.154598:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330037.154622:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792284544:0@lo:400: 00000100:00100000:0.0:1788330037.154651:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330037.154681:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788330037.154687:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792283904:0@lo:400: 00000100:00100000:0.0:1788330037.154711:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330037.154728:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792284416:0@lo:400: 00000100:00100000:0.0:1788330037.154749:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330037.154779:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792283776:0@lo:400: 00000100:00100000:0.0:1788330037.154815:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330037.156361:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792284288:0@lo:400: 00000100:00100000:0.0:1788330037.156471:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330037.156530:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792284800:0@lo:400: 00000100:00100000:0.0:1788330037.156559:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330037.156594:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788330037.156600:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792283648:0@lo:13: 00000100:00100000:0.0:1788330037.156623:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330037.156640:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792284160:0@lo:400: 00000100:00100000:0.0:1788330037.156665:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330037.156685:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792284672:0@lo:400: 00000100:00100000:0.0:1788330037.156705:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330037.156751:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792283520 00000100:00100000:0.0:1788330037.156776:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792283520 00000100:00100000:3.0:1788330037.161767:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792284032 00000100:00100000:0.0:1788330037.161767:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792283648 00000100:00100000:3.0:1788330037.161784:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792284032 00000100:00100000:0.0:1788330037.161784:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792283648 00000100:00100000:0.0:1788330037.161844:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788330037.161848:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792284288 00000100:00100000:3.0:1788330037.161851:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792284288 00000100:00100000:0.0:1788330037.161856:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792283520:12345-0@lo:13: 00000100:00100000:3.0:1788330037.161865:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788330037.161872:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792284032:12345-0@lo:400: 00002000:00000024:0.0:1788330037.161907:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00010000:1.0:1788330037.163294:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330037.167262:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792283520:12345-0@lo:13: Request processed in 5396us (12761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330037.167282:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788330037.167333:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788330037.167351:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792283648:12345-0@lo:13: 00002000:00000024:0.0:1788330037.167385:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330037.167438:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792283648:12345-0@lo:13: Request processed in 96us (10814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330037.167444:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788330037.167474:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792284544 00000100:00100000:0.0:1788330037.167484:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792284544 00000100:00100000:0.0:1788330037.167528:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792283904 00000100:00100000:0.0:1788330037.167532:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792283904 00000100:00100000:0.0:1788330037.167544:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792284416 00000100:00100000:0.0:1788330037.167547:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792284416 00000100:00100000:0.0:1788330037.167560:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792284160 00000100:00100000:0.0:1788330037.167563:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792284160 00000100:00100000:0.0:1788330037.167577:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788330037.167584:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792284544:12345-0@lo:400: 00000100:00100000:0.0:1788330037.167622:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792284544:12345-0@lo:400: Request processed in 39us (12971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330037.167629:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788330037.167642:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788330037.167655:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792283904:12345-0@lo:400: 00000100:00100000:0.0:1788330037.167686:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792283904:12345-0@lo:400: Request processed in 32us (12974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330037.167693:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788330037.167705:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788330037.167711:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792284416:12345-0@lo:400: 00000100:00100000:0.0:1788330037.167741:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792284416:12345-0@lo:400: Request processed in 30us (12991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330037.167747:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788330037.167759:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788330037.167765:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792284160:12345-0@lo:400: 00000100:00100000:0.0:1788330037.167790:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792284160:12345-0@lo:400: Request processed in 26us (11124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330037.167796:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788330037.167839:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788330037.167849:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792284288:12345-0@lo:400: 00000100:00100000:0.0:1788330037.167896:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792284288:12345-0@lo:400: Request processed in 49us (11429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330037.167903:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788330037.167939:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792284800 00000100:00100000:0.0:1788330037.167943:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792284800 00000100:00100000:0.0:1788330037.167973:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792284672 00000100:00100000:0.0:1788330037.167976:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792284672 00000100:00100000:0.0:1788330037.168003:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788330037.168010:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792284800:12345-0@lo:400: 00000100:00100000:0.0:1788330037.168043:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792284800:12345-0@lo:400: Request processed in 34us (11483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330037.168055:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788330037.168067:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788330037.168073:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792284672:12345-0@lo:400: 00000100:00100000:0.0:1788330037.168102:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792284672:12345-0@lo:400: Request processed in 29us (11396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330037.168107:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788330037.168124:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330037.168130:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788330037.168133:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788330037.168184:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6fe7100 x1875199792283904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330037.168204:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792283904:0@lo:400: 00010000:00080000:0.0:1788330037.168219:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6d43b80 x1875199792284416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330037.168229:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792284416:0@lo:400: 00010000:00080000:0.0:1788330037.168242:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6fe4700 x1875199792283520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330037.168259:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792283520:0@lo:13: 00010000:00080000:0.0:1788330037.168273:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6d40e00 x1875199792284544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330037.168283:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792284544:0@lo:400: 00010000:00080000:0.0:1788330037.168340:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6fe4e00 x1875199792283648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330037.168353:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792283648:0@lo:13: 00010000:00080000:0.0:1788330037.168373:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eee7640a80 x1875199792284160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330037.168382:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792284160:0@lo:400: 00010000:00080000:0.0:1788330037.168392:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6d40a80 x1875199792284672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330037.168400:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792284672:0@lo:400: 00000100:00100000:0.0:1788330037.168413:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792284288:0@lo:400: 00010000:00080000:0.0:1788330037.168422:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6d43800 x1875199792284800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330037.168430:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792284800:0@lo:400: 00000100:00100000:3.0:1788330037.172182:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792284032:12345-0@lo:400: Request processed in 10299us (17571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330037.172201:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788330037.172266:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792283776 00000100:00100000:3.0:1788330037.172278:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792283776 00000100:00100000:3.0:1788330037.172323:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788330037.172333:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec2d19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:3647:x1875199792283776:12345-0@lo:400: 00000100:00100000:3.0:1788330037.172425:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec2d19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:3647:x1875199792283776:12345-0@lo:400: Request processed in 94us (17609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330037.172432:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788330037.172531:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792284032:0@lo:400: 00000100:00100000:3.0:1788330037.172575:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792283776:0@lo:400: 00010000:00010000:2.0:1788330038.182187:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330038.184005:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792284928:0@lo:41: 00000100:00100000:1.0:1788330038.184127:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330038.184490:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792284928 00000100:00100000:0.0:1788330038.184505:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792284928 00000100:00100000:0.0:1788330038.184587:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788330038.184600:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792284928:12345-0@lo:41: 00000004:00000024:0.0:1788330038.184652:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788330038.184743:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792284928:12345-0@lo:41: Request processed in 137us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330038.184750:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788330038.184873:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792284928:0@lo:41: 00010000:00010000:1.0:1788330039.216445:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330040.220265:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330040.735067:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330040.735101:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792285056:0@lo:41: 00000100:00100000:3.0:1788330040.735222:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330040.735306:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792285056 00000100:00100000:3.0:1788330040.735315:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792285056 00000100:00100000:3.0:1788330040.735381:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788330040.735392:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792285056:12345-0@lo:41: 00000004:00000024:3.0:1788330040.735438:0:7831:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788330040.735490:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792285056:12345-0@lo:41: Request processed in 100us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330040.735498:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788330040.735552:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792285056:0@lo:41: 00000020:01000004:0.0:1788330041.171340:0:9516:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788330041.171347:0:9516:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788330041.171349:0:9516:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788330041.171510:0:9516:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99eef6de3800 00000020:01000004:0.0:1788330041.171530:0:9516:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788330041.171549:0:9516:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788330041.171566:0:9516:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99eef5833370) 00000020:00000080:0.0:1788330041.171587:0:9516:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1788330041.245859:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788330041.255176:0:9516:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788330041.255246:0:9516:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1788330041.280692:0:9516:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788330041.281041:0:9516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788330041.281058:0:9516:0:(osd_handler.c:8927:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788330041.281073:0:9516:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8475908e9fd0d3f 00000020:01000004:3.0:1788330041.281083:0:9516:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788330041.281108:0:9516:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.150@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788330041.281112:0:9516:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788330041.281122:0:9516:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788330041.281382:0:9516:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788330041.281389:0:9516:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788330041.297401:0:9516:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788330041.297455:0:9516:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.150@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788330041.297460:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788330041.297462:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788330041.297463:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330041.297464:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330041.297466:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330041.297467:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330041.297469:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788330041.297470:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788330041.297472:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788330041.297474:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330041.297475:0:9516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788330041.297480:0:9516:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788330041.297483:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788330041.297485:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788330041.297486:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330041.297487:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330041.297488:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330041.297489:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330041.297490:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788330041.297492:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788330041.297492:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788330041.297493:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330041.297494:0:9516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788330041.297533:0:9516:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788330041.297560:0:9516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eeaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792285184:0@lo:253: 00000100:00100000:3.0:1788330041.297665:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330041.297801:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee76e7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788330041.297924:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792285184 00000100:00100000:2.0:1788330041.297933:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792285184 00000100:00100000:2.0:1788330041.298030:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788330041.298049:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec2d19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:9516:x1875199792285184:12345-0@lo:253: 20000000:01000000:2.0:1788330041.298100:0:6517:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788330041.298104:0:6517:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788330041.298109:0:6517:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788330041.298113:0:6517:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788330041.298372:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788330041.298500:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1788330041.298518:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788330041.298537:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1788330041.298544:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788330041.298556:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1788330041.298571:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1788330041.298660:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1788330041.298676:0:6517:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.150@tcp 20000000:01000000:2.0:1788330041.298678:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.150@tcp (null) (null) (null) 00000040:00080000:2.0:1788330041.298693:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1788330041.298700:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788330041.298714:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1788330041.298719:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.150@tcp (null) (null) 00000040:00080000:2.0:1788330041.298730:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1788330041.298736:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788330041.298746:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1788330041.298760:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1788330041.299513:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1788330041.299531:0:6517:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.150@tcp 20000000:01000000:2.0:1788330041.299533:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.150@tcp (null) (null) (null) 00000040:00080000:2.0:1788330041.299550:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1788330041.299557:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788330041.299571:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1788330041.299577:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.150@tcp (null) (null) 00000040:00080000:2.0:1788330041.299590:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1788330041.299608:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788330041.299624:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1788330041.299639:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1788330041.300812:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1788330041.301964:0:6517:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.150@tcp 20000000:01000000:2.0:1788330041.301968:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.150@tcp (null) (null) (null) 00000040:00080000:2.0:1788330041.302004:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1788330041.302011:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788330041.302024:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1788330041.302029:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.150@tcp (null) (null) 00000040:00080000:2.0:1788330041.302044:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1788330041.302051:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788330041.302061:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1788330041.302073:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1788330041.302088:0:6517:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788330041.302091:0:6517:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788330041.302094:0:6517:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788330041.302138:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788330041.302141:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788330041.302396:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1788330041.302416:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1788330041.302433:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1788330041.302532:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1788330041.302551:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1788330041.302566:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1788330041.302577:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788330041.302578:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788330041.303425:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1788330041.303616:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1788330041.303641:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1788330041.303659:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1788330041.303669:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788330041.303671:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788330041.304078:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1788330041.304111:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1788330041.304125:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788330041.304389:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788330041.304410:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1788330041.304425:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1788330041.304435:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788330041.304437:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788330041.304692:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1788330041.304708:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1788330041.304719:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1788330041.304931:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1788330041.304953:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1788330041.304966:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1788330041.304975:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788330041.304978:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788330041.305427:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1788330041.305447:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1788330041.305465:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1788330041.305622:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1788330041.305644:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1788330041.305658:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:2.0:1788330041.305673:0:6517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788330041.305694:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0d46 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.305712:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ef02065600/0x8475908e9fd0c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0c35 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.305719:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef59cb400/0x8475908e9fd0c66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0c5f expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.305726:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef58c2800/0x8475908e9fd0ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0c9e expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.305733:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef59ca400/0x8475908e9fd0cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0cba expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.305739:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eec147ba00/0x8475908e9fd0ceb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0ce4 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.305746:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ef02064200/0x8475908e9fd0d07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0d00 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.305761:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef59ca600/0x8475908e9fd0d31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0d2a expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.305768:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0d46 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.305893:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef59ca600/0x8475908e9fd0d31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0d2a expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.305908:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eef59ca600/0x8475908e9fd0d31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0d2a expref: 21 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330041.305924:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1875199792285312:0@lo:104: 00000100:00100000:2.0:1788330041.305992:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330041.306082:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ef02064200/0x8475908e9fd0d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0d00 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.306091:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ef02064200/0x8475908e9fd0d07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0d00 expref: 21 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330041.306100:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1875199792285440:0@lo:104: 00000100:00100000:2.0:1788330041.306120:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330041.306367:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eec147ba00/0x8475908e9fd0ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0ce4 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.306376:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eec147ba00/0x8475908e9fd0ceb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0ce4 expref: 21 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330041.306385:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1875199792285568:0@lo:104: 00000100:00100000:2.0:1788330041.306418:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330041.306452:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792285312 00000100:00100000:0.0:1788330041.306460:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792285312 00000100:00100000:0.0:1788330041.306499:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792285440 00000100:00100000:0.0:1788330041.306502:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792285440 00000100:00100000:0.0:1788330041.306518:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788330041.306528:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:6517:x1875199792285312:12345-0@lo:104: 00010000:00010000:0.0:1788330041.306541:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0d2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0d31 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.306594:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788330041.306601:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:6517:x1875199792285312:12345-0@lo:104: Request processed in 75us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330041.306608:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788330041.306628:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788330041.306635:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:6517:x1875199792285440:12345-0@lo:104: 00010000:00010000:0.0:1788330041.306642:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0d00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0d07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.306678:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788330041.306683:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:6517:x1875199792285440:12345-0@lo:104: Request processed in 50us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330041.306695:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788330041.306714:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788330041.306720:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0d2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0d31 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.306727:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147b000 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330041.306732:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0d2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0d31 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.306740:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0d2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0d31 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330041.306748:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0d2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0d31 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330041.306754:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788330041.306781:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0d2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0d31 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.306799:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330041.306816:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0d2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0d31 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.306835:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0d2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0d31 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.306847:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330041.306851:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0d00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0d07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.306868:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c2200 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330041.306871:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0d00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0d07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.306878:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0d07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330041.306883:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0d07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330041.306888:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788330041.306902:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0d00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0d07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.306907:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330041.306913:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0d00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0d07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.306918:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0d00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0d07 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.306927:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330041.306929:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330041.306930:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330041.306943:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792285696:0@lo:103: 00000100:00100000:0.0:1788330041.306972:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330041.307000:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330041.307005:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792285824:0@lo:103: 00000100:00100000:0.0:1788330041.307036:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330041.307215:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330041.307366:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792285696 00000100:00100000:1.0:1788330041.307371:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792285696 00010000:00010000:1.0:1788330041.307393:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef59ca600/0x8475908e9fd0d31 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0d2a expref: 22 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330041.307654:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792285824 00000100:00100000:1.0:1788330041.307659:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792285824 00010000:00010000:1.0:1788330041.307671:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ef02064200/0x8475908e9fd0d07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0d00 expref: 23 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330041.307690:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788330041.307697:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:3646:x1875199792285696:12345-0@lo:103: 00010000:00010000:1.0:1788330041.307708:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330041.307714:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef59ca600/0x8475908e9fd0d31 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0d2a expref: 23 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.307735:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef59ca600/0x8475908e9fd0d31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0d2a expref: 23 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.307752:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330041.307801:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:3646:x1875199792285696:12345-0@lo:103: Request processed in 105us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330041.307808:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788330041.307823:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788330041.307829:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:3646:x1875199792285824:12345-0@lo:103: 00010000:00010000:1.0:1788330041.307836:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330041.307841:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ef02064200/0x8475908e9fd0d07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0d00 expref: 22 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.307850:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ef02064200/0x8475908e9fd0d07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0d00 expref: 22 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.307860:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330041.307882:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:3646:x1875199792285824:12345-0@lo:103: Request processed in 54us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330041.307888:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788330041.307948:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792285824:0@lo:103: 00000100:00100000:1.0:1788330041.307956:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792285696:0@lo:103: 00010000:00010000:2.0:1788330041.309051:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef59ca400/0x8475908e9fd0cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0cba expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.309068:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eef59ca400/0x8475908e9fd0cc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0cba expref: 21 pid: 6517 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330041.309082:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1875199792285952:0@lo:104: 00000100:00100000:2.0:1788330041.309130:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330041.309169:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef58c2800/0x8475908e9fd0ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0c9e expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.309177:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eef58c2800/0x8475908e9fd0ca5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0c9e expref: 21 pid: 6517 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330041.309186:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1875199792286080:0@lo:104: 00000100:00100000:2.0:1788330041.309208:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330041.309231:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef59cb400/0x8475908e9fd0c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0c5f expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.309239:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eef59cb400/0x8475908e9fd0c66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0c5f expref: 21 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330041.309247:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1875199792286208:0@lo:104: 00000100:00100000:2.0:1788330041.309269:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330041.309286:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ef02065600/0x8475908e9fd0c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0c35 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.309295:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ef02065600/0x8475908e9fd0c3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0c35 expref: 21 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330041.309316:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1875199792286336:0@lo:104: 00000100:00100000:2.0:1788330041.309339:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70cccc0 going to sleep for 11 seconds 00010000:00010000:2.0:1788330041.309361:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef59ca600/0x8475908e9fd0d31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0d2a expref: 21 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330041.309372:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1875199792285312:0@lo:104: 00010000:00010000:2.0:1788330041.309382:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ef02064200/0x8475908e9fd0d07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0d00 expref: 20 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330041.309392:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1875199792285440:0@lo:104: 00000100:00100000:3.0:1788330041.309484:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792285568 00000100:00100000:3.0:1788330041.309490:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792285568 00000100:00100000:3.0:1788330041.309546:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788330041.309566:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330041.309583:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792285952 00000100:00100000:3.0:1788330041.309587:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792285952 00000100:00100000:3.0:1788330041.309600:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792286080 00000100:00100000:3.0:1788330041.309603:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792286080 00000100:00100000:3.0:1788330041.309611:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792286208 00000100:00100000:3.0:1788330041.309613:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792286208 00000100:00100000:3.0:1788330041.309622:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792286336 00000100:00100000:3.0:1788330041.309624:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792286336 00000100:00100000:3.0:1788330041.309635:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788330041.309642:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+7:6517:x1875199792285568:12345-0@lo:104: 00010000:00010000:3.0:1788330041.309653:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0ceb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330041.309716:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788330041.309722:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+7:6517:x1875199792285568:12345-0@lo:104: Request processed in 80us (3304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330041.309729:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788330041.309747:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788330041.309753:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+6:6517:x1875199792285952:12345-0@lo:104: 00010000:00010000:3.0:1788330041.309761:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd0cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0cc1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330041.309806:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788330041.309811:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+6:6517:x1875199792285952:12345-0@lo:104: Request processed in 60us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330041.309817:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788330041.309929:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1875199792285568:0@lo:104: 00000100:00100000:2.0:1788330041.309938:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1875199792285952:0@lo:104: 00000100:00100000:3.0:1788330041.309987:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788330041.309994:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+5:6517:x1875199792286080:12345-0@lo:104: 00010000:00010000:3.0:1788330041.310002:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0ca5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330041.310054:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788330041.310060:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+5:6517:x1875199792286080:12345-0@lo:104: Request processed in 67us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330041.310066:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788330041.310080:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788330041.310086:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:6517:x1875199792286208:12345-0@lo:104: 00010000:00010000:3.0:1788330041.310094:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef58c3a00/0x8475908e9fd0c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0c66 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330041.310125:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788330041.310131:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5c5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:6517:x1875199792286208:12345-0@lo:104: Request processed in 45us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330041.310137:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788330041.310197:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788330041.310205:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:6517:x1875199792286336:12345-0@lo:104: 00010000:00010000:3.0:1788330041.310213:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef59ca000/0x8475908e9fd0c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0c3c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330041.310240:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788330041.310245:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:6517:x1875199792286336:12345-0@lo:104: Request processed in 43us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330041.310251:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788330041.310352:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1875199792286080:0@lo:104: 00000100:00100000:2.0:1788330041.310359:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1875199792286208:0@lo:104: 00000100:00100000:2.0:1788330041.310367:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1875199792286336:0@lo:104: 00010000:00010000:2.0:1788330041.310399:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0d46 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.310466:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788330041.310473:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0ceb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.310481:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147be00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330041.310485:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0ceb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.310493:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0ceb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330041.310500:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0ceb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330041.310505:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788330041.310584:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0ce4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0ceb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.310593:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330041.310620:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0ce4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0ceb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.310628:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0ce4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0ceb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.310643:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788330041.310646:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd0cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0cc1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.310665:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147b600 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330041.310668:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd0cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0cc1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.310675:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd0cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0cc1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330041.310682:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd0cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0cc1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330041.310687:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788330041.310735:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792286464:0@lo:103: 00000100:00100000:3.0:1788330041.310773:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330041.310978:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd0cba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0cc1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.310985:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330041.311000:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd0cba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0cc1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.311007:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd0cba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0cc1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.311016:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788330041.311020:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0ca5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.311026:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c3600 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330041.311029:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0ca5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.311048:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0ca5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330041.311054:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0ca5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330041.311059:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788330041.311089:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330041.311097:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792286592:0@lo:103: 00000100:00100000:3.0:1788330041.311129:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330041.311346:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0c9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0ca5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.311353:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330041.311368:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0c9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0ca5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.311374:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0c9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0ca5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.311385:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788330041.311388:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef58c3a00/0x8475908e9fd0c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0c66 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.311394:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c3a00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330041.311396:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c3a00/0x8475908e9fd0c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0c66 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.311402:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef58c3a00/0x8475908e9fd0c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0c66 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330041.311408:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c3a00/0x8475908e9fd0c5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0c66 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330041.311419:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788330041.311530:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef58c3a00/0x8475908e9fd0c5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0c66 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.311537:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330041.311543:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef58c3a00/0x8475908e9fd0c5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0c66 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.311550:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef58c3a00/0x8475908e9fd0c5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0c66 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.311559:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330041.311562:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef59ca000/0x8475908e9fd0c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0c3c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.311567:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59ca000 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330041.311569:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef59ca000/0x8475908e9fd0c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0c3c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.311576:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef59ca000/0x8475908e9fd0c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0c3c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330041.311581:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef59ca000/0x8475908e9fd0c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0c3c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330041.311587:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788330041.311667:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef59ca000/0x8475908e9fd0c35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0c3c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.311673:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788330041.311689:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792286464 00010000:00010000:0.0:1788330041.311695:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef59ca000/0x8475908e9fd0c35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0c3c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330041.311696:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792286464 00010000:00010000:0.0:1788330041.311702:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef59ca000/0x8475908e9fd0c35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0c3c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.311714:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330041.311716:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330041.311718:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330041.311724:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eec147ba00/0x8475908e9fd0ceb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0ce4 expref: 20 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330041.311725:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330041.311735:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792286976:0@lo:103: 00000100:00100000:1.0:1788330041.311759:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792286592 00000100:00100000:1.0:1788330041.311763:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792286592 00000100:00100000:0.0:1788330041.311769:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788330041.311774:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef59ca400/0x8475908e9fd0cc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0cba expref: 21 pid: 6517 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330041.311796:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792286976 00000100:00100000:1.0:1788330041.311799:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792286976 00010000:00010000:1.0:1788330041.311810:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ef02065600/0x8475908e9fd0c3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0c35 expref: 22 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330041.311815:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792286848:0@lo:103: 00000100:00100000:1.0:1788330041.311823:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788330041.311832:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:3648:x1875199792286464:12345-0@lo:103: 00010000:00010000:1.0:1788330041.311843:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330041.311848:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eec147ba00/0x8475908e9fd0ceb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0ce4 expref: 22 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.311859:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eec147ba00/0x8475908e9fd0ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0ce4 expref: 22 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.311873:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec147ba00/0x8475908e9fd0ceb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0ce4 expref: 22 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.311887:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330041.311923:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:3648:x1875199792286464:12345-0@lo:103: Request processed in 92us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330041.311930:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788330041.311932:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792286464:0@lo:103: 00000100:00100000:1.0:1788330041.311945:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788330041.311951:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec986d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:3648:x1875199792286592:12345-0@lo:103: 00010000:00010000:1.0:1788330041.311967:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330041.311972:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef59ca400/0x8475908e9fd0cc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0cba expref: 20 pid: 6517 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.311980:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef59ca400/0x8475908e9fd0cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0cba expref: 20 pid: 6517 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330041.311984:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788330041.311991:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef59ca400/0x8475908e9fd0cc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0cba expref: 20 pid: 6517 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330041.311997:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1788330041.311998:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330041.312003:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792286720:0@lo:103: 00000100:00100000:0.0:1788330041.312019:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330041.312030:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec986d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:3648:x1875199792286592:12345-0@lo:103: Request processed in 80us (900us total) trans 0 rc 0/0 00010000:00010000:0.0:1788330041.312036:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330041.312037:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788330041.312073:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792286848 00000100:00100000:1.0:1788330041.312078:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792286848 00000100:00100000:3.0:1788330041.312087:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792286592:0@lo:103: 00010000:00010000:1.0:1788330041.312088:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef59cb400/0x8475908e9fd0c66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0c5f expref: 19 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330041.312099:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792286720 00000100:00100000:1.0:1788330041.312102:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792286720 00010000:00010000:1.0:1788330041.312111:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef58c2800/0x8475908e9fd0ca5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0c9e expref: 20 pid: 6517 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330041.312123:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788330041.312128:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:3649:x1875199792286976:12345-0@lo:103: 00010000:00010000:1.0:1788330041.312135:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330041.312138:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ef02065600/0x8475908e9fd0c3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0c35 expref: 20 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.312206:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ef02065600/0x8475908e9fd0c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0c35 expref: 20 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330041.312301:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788330041.312312:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:3647:x1875199792286848:12345-0@lo:103: 00010000:00010000:0.0:1788330041.312320:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330041.312325:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef59cb400/0x8475908e9fd0c66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0c5f expref: 20 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.313078:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ef02065600/0x8475908e9fd0c3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0c35 expref: 20 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.313102:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef59cb400/0x8475908e9fd0c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0c5f expref: 19 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.313110:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330041.313113:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef59cb400/0x8475908e9fd0c66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0c5f expref: 19 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.313133:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330041.313237:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792286976:0@lo:103: 00000100:00100000:0.0:1788330041.313344:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:3647:x1875199792286848:12345-0@lo:103: Request processed in 1034us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330041.313352:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788330041.313375:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788330041.313384:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:3647:x1875199792286720:12345-0@lo:103: 00010000:00010000:0.0:1788330041.313393:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330041.313397:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef58c2800/0x8475908e9fd0ca5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0c9e expref: 17 pid: 6517 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.313406:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef58c2800/0x8475908e9fd0ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0c9e expref: 17 pid: 6517 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.313414:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c2800/0x8475908e9fd0ca5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0c9e expref: 17 pid: 6517 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.313425:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0d46 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.313432:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0d46 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.313459:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0d46 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.313466:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0d46 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.313472:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0d46 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.313484:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0d46 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.313491:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02065c00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330041.313495:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0d46 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.313503:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0d46 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330041.313521:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:3649:x1875199792286976:12345-0@lo:103: Request processed in 1391us (1750us total) trans 0 rc 0/0 00010000:00010000:0.0:1788330041.313525:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0d46 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330041.313528:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1788330041.313535:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330041.313560:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:3647:x1875199792286720:12345-0@lo:103: Request processed in 180us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330041.313566:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788330041.313856:0:6517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0d46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330041.313865:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0d46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330041.313872:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0d46 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788330041.313886:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788330041.314019:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792286848:0@lo:103: 00000100:00100000:2.0:1788330041.314038:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792286720:0@lo:103: 00000100:00100000:2.0:1788330041.316347:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec2d19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:9516:x1875199792285184:12345-0@lo:253: Request processed in 18289us (18671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330041.316361:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788330041.316465:0:9516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eeaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792285184:0@lo:253: 10000000:01000000:3.0:1788330041.316482:0:9516:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788330041.316486:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788330041.316488:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788330041.316489:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330041.316490:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788330041.316492:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330041.316493:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330041.316494:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788330041.316496:0:9516:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788330041.316497:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330041.316499:0:9516:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788330041.316523:0:9516:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99eef6de3800 from lustre-OST0001 10000000:01000000:3.0:1788330041.316554:0:9516:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788330041.316557:0:9516:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788330041.316566:0:9516:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99eee7570000 local copy 10000000:01000000:3.0:1788330041.316570:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788330041.316619:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cba00/0x8475908e9fd0d4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330041.316631:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.150@tcp lock: ffff99eef59cba00/0x8475908e9fd0d4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330041.316640:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef59cba00/0x8475908e9fd0d4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330041.316658:0:9516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eeaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792287104:0@lo:101: 00000100:00100000:3.0:1788330041.316696:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330041.316736:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6e9ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330041.316799:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792287104 00000100:00100000:2.0:1788330041.316811:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792287104 00000100:00100000:2.0:1788330041.316954:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788330041.316964:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+14:9516:x1875199792287104:12345-0@lo:101: 00010000:00010000:2.0:1788330041.316978:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330041.316993:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ef02064200/0x8475908e9fd0d54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0d4d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.317015:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ef02064200/0x8475908e9fd0d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0d4d expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.317025:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ef02064200/0x8475908e9fd0d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0d4d expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.317035:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ef02064200, rc 0) 00000100:00100000:2.0:1788330041.317080:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:9516:x1875199792287104:12345-0@lo:101: Request processed in 117us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330041.317087:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788330041.318509:0:9516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eeaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792287104:0@lo:101: 00010000:00010000:1.0:1788330041.318532:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef59cba00/0x8475908e9fd0d4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8475908e9fd0d54 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.318543:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef59cba00/0x8475908e9fd0d4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8475908e9fd0d54 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330041.318666:0:9516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792287232:0@lo:501: 00000100:00100000:1.0:1788330041.318718:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330041.318848:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec8c6b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788330041.318943:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792287232 00000100:00100000:2.0:1788330041.318949:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792287232 00000100:00100000:2.0:1788330041.318993:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788330041.319001:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:9516:x1875199792287232:12345-0@lo:501: 00000100:00100000:2.0:1788330041.319071:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:9516:x1875199792287232:12345-0@lo:501: Request processed in 71us (353us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788330041.319079:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788330041.319087:0:9516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792287232:0@lo:501: 10000000:01000000:1.0:1788330041.319101:0:9516:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788330041.319119:0:9516:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788330041.319124:0:9516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cba00/0x8475908e9fd0d4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8475908e9fd0d54 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.319132:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cba00/0x8475908e9fd0d4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8475908e9fd0d54 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.319172:0:9516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eef59cba00/0x8475908e9fd0d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8475908e9fd0d54 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.319347:0:9516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788330041.319381:0:9516:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99eef6de3800 10000000:01000000:1.0:1788330041.319386:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788330041.319392:0:9516:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788330041.319396:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788330041.319401:0:9516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788330041.319404:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788330041.319428:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.319437:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.319447:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330041.319460:0:9516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792287360:0@lo:101: 00000100:00100000:1.0:1788330041.319490:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330041.319524:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec8c6b300 going to sleep for 11 seconds 00010000:00010000:0.0:1788330041.320406:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330041.320417:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef59cba00/0x8475908e9fd0d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8475908e9fd0d54 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.320429:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cba00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330041.320435:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef59cba00/0x8475908e9fd0d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8475908e9fd0d54 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.320444:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef59cba00/0x8475908e9fd0d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x8475908e9fd0d54 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330041.320452:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef59cba00/0x8475908e9fd0d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x8475908e9fd0d54 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330041.320472:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788330041.320500:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef59cba00/0x8475908e9fd0d4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8475908e9fd0d54 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.320506:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788330041.320640:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792287488:0@lo:103: 00000100:00100000:1.0:1788330041.320687:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330041.320749:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef59cba00/0x8475908e9fd0d4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8475908e9fd0d54 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.320758:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef59cba00/0x8475908e9fd0d4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8475908e9fd0d54 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.320773:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330041.320775:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330041.320776:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330041.320851:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792287360 00000100:00100000:3.0:1788330041.320858:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792287360 00000100:00100000:3.0:1788330041.320905:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788330041.320912:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef40a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:9516:x1875199792287360:12345-0@lo:101: 00010000:00010000:3.0:1788330041.320924:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330041.320937:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef59ca800/0x8475908e9fd0d62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0d5b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330041.320960:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef59ca800/0x8475908e9fd0d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0d5b expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330041.320969:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef59ca800/0x8475908e9fd0d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0d5b expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330041.320978:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59ca800, rc 0) 00000100:00100000:3.0:1788330041.321013:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef40a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:9516:x1875199792287360:12345-0@lo:101: Request processed in 101us (1522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330041.321019:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788330041.322324:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792287488 00000100:00100000:0.0:1788330041.322337:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792287488 00000100:00100000:0.0:1788330041.322396:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788330041.322407:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:3649:x1875199792287488:12345-0@lo:103: 00010000:00010000:0.0:1788330041.322423:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330041.322443:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ef02064200/0x8475908e9fd0d54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd0d4d expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.322463:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330041.323970:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:3649:x1875199792287488:12345-0@lo:103: Request processed in 1559us (3276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330041.323983:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788330041.324111:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792287488:0@lo:103: 00000100:00100000:1.0:1788330041.324188:0:9516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792287360:0@lo:101: 00010000:00010000:1.0:1788330041.324210:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0d5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0d62 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.324243:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0d5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0d62 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330041.324367:0:9516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792287616:0@lo:501: 00000100:00100000:1.0:1788330041.324419:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330041.324702:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec8c6b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788330041.324871:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792287616 00000100:00100000:3.0:1788330041.324878:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792287616 00000100:00100000:3.0:1788330041.324972:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788330041.324983:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:9516:x1875199792287616:12345-0@lo:501: 00000100:00100000:3.0:1788330041.325131:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:9516:x1875199792287616:12345-0@lo:501: Request processed in 150us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330041.325138:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788330041.325241:0:9516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792287616:0@lo:501: 00000100:00100000:1.0:1788330041.325297:0:9516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792287744:0@lo:503: 00000100:00100000:1.0:1788330041.325339:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330041.325651:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec8c6b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788330041.325716:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792287744 00000100:00100000:2.0:1788330041.325722:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792287744 00000100:00100000:2.0:1788330041.325748:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788330041.325754:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:9516:x1875199792287744:12345-0@lo:503: 00000100:00100000:2.0:1788330041.325865:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:9516:x1875199792287744:12345-0@lo:503: Request processed in 110us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330041.325880:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788330041.326044:0:9516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792287744:0@lo:503: 00000040:00080000:1.0:1788330041.326347:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788330041.326425:0:9516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792287872:0@lo:502: 00000100:00100000:1.0:1788330041.326479:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330041.326498:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec8c6b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788330041.326633:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792287872 00000100:00100000:2.0:1788330041.326638:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792287872 00000100:00100000:0.0:1788330041.326908:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788330041.326919:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00beb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:9516:x1875199792287872:12345-0@lo:502: 00000100:00100000:0.0:1788330041.327008:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00beb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:9516:x1875199792287872:12345-0@lo:502: Request processed in 94us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330041.327013:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788330041.327086:0:9516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792287872:0@lo:502: 00000040:00080000:1.0:1788330041.327350:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788330041.327380:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788330041.327395:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788330041.327408:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788330041.327434:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788330041.327461:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788330041.327486:0:9516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792288000:0@lo:502: 00000100:00100000:1.0:1788330041.327522:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330041.327550:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec8c6b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788330041.327666:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792288000 00000100:00100000:0.0:1788330041.327671:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792288000 00000100:00100000:0.0:1788330041.327694:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788330041.327701:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00bea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:9516:x1875199792288000:12345-0@lo:502: 00000100:00100000:0.0:1788330041.327792:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00bea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:9516:x1875199792288000:12345-0@lo:502: Request processed in 80us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330041.327799:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788330041.327882:0:9516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792288000:0@lo:502: 00000040:00080000:1.0:1788330041.327920:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788330041.327928:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1788330041.328374:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788330041.328383:0:9527:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788330041.328390:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330041.328392:0:9527:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788330041.328397:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788330041.328421:0:9527:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99edc67d8000) 00000020:00000080:1.0:1788330041.328465:0:9527:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788330041.328473:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788330041.328563:0:9527:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99eef6de3800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788330041.328572:0:9527:0:(osd_handler.c:8927:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788330041.328579:0:9527:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8475908e9fd0d70 00010000:00010000:1.0:1788330041.342925:0:9527:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1788330041.343290:0:9527:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788330041.346565:0:9527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788330041.346999:0:9527:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788330041.356063:0:9527:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1788330041.356352:0:9527:0:(osd_compat.c:1354:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1788330041.361985:0:9527:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788330041.363403:0:9527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788330041.363417:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330041.363425:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330041.363427:0:9527:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788330041.363433:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330041.363438:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330041.363452:0:9527:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788330041.363457:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788330041.363459:0:9527:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788330041.363491:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330041.363495:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330041.363496:0:9527:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788330041.363500:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788330041.363665:0:9516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788330041.363695:0:9516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788330041.363718:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0d62 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.363731:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0d62 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330041.363739:0:9516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eef6de3800 from 1 10000000:01000000:0.0:1788330041.363742:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788330041.363776:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0d77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.363795:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0d77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.364070:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0d77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330041.364097:0:9516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792288128:0@lo:101: 00000100:00100000:0.0:1788330041.364188:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330041.364227:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc177a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788330041.364251:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792288128 00000100:00100000:0.0:1788330041.364257:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792288128 00000100:00100000:0.0:1788330041.364298:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788330041.364307:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00bea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:9516:x1875199792288128:12345-0@lo:101: 00010000:00010000:0.0:1788330041.364319:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330041.364330:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef58c3a00/0x8475908e9fd0d7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0d77 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.364352:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef58c3a00/0x8475908e9fd0d7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0d77 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.364363:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef58c3a00/0x8475908e9fd0d7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0d77 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.364372:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c3a00, rc 0) 00000100:00100000:0.0:1788330041.364404:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00bea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:9516:x1875199792288128:12345-0@lo:101: Request processed in 98us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330041.364411:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788330041.366522:0:9516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792288128:0@lo:101: 00010000:00010000:0.0:1788330041.366550:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0d77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0d7e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.366575:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0d77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0d7e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330041.366697:0:9516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792288256:0@lo:501: 00000100:00100000:0.0:1788330041.366758:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330041.366813:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59db3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330041.366961:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792288256 00000100:00100000:1.0:1788330041.366968:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792288256 00000100:00100000:1.0:1788330041.367019:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788330041.367032:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:9516:x1875199792288256:12345-0@lo:501: 00000100:00100000:1.0:1788330041.367181:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:9516:x1875199792288256:12345-0@lo:501: Request processed in 152us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330041.367188:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788330041.367314:0:9516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b67800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792288256:0@lo:501: 00000100:00100000:2.0:1788330041.367350:0:9516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792288384:0@lo:503: 00000100:00100000:2.0:1788330041.367392:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330041.367422:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70cc000 going to sleep for 11 seconds 00000100:00100000:1.0:1788330041.367471:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792288384 00000100:00100000:1.0:1788330041.367475:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792288384 00000100:00100000:1.0:1788330041.367508:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788330041.367516:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:9516:x1875199792288384:12345-0@lo:503: 00000100:00100000:1.0:1788330041.367599:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:9516:x1875199792288384:12345-0@lo:503: Request processed in 82us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330041.367612:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788330041.367653:0:9516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792288384:0@lo:503: 00000040:00080000:1.0:1788330041.368081:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788330041.368269:0:9516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792288512:0@lo:502: 00000100:00100000:0.0:1788330041.368427:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330041.368543:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec8c6ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788330041.368575:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792288512 00000100:00100000:1.0:1788330041.368579:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792288512 00000100:00100000:1.0:1788330041.368642:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788330041.368650:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:9516:x1875199792288512:12345-0@lo:502: 00000100:00100000:1.0:1788330041.368802:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:9516:x1875199792288512:12345-0@lo:502: Request processed in 151us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330041.368809:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788330041.368948:0:9516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792288512:0@lo:502: 00000040:00080000:2.0:1788330041.369373:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788330041.369522:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788330041.369550:0:9516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792288640:0@lo:502: 00000100:00100000:2.0:1788330041.369598:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330041.369673:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70cca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788330041.369711:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792288640 00000100:00100000:1.0:1788330041.369717:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792288640 00000100:00100000:1.0:1788330041.369799:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788330041.369809:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:9516:x1875199792288640:12345-0@lo:502: 00000100:00100000:1.0:1788330041.369985:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:9516:x1875199792288640:12345-0@lo:502: Request processed in 176us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330041.369992:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788330041.370061:0:9516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792288640:0@lo:502: 00000040:00080000:2.0:1788330041.370100:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788330041.370114:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788330041.370652:0:9531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330041.370663:0:9531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330041.370666:0:9531:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788330041.370673:0:9531:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99eef6de3800 00000020:00000080:1.0:1788330041.370675:0:9531:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788330041.370687:0:9531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330041.370690:0:9531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330041.370691:0:9531:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788330041.370694:0:9531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788330041.370928:0:9516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788330041.370959:0:9516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788330041.371016:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0d77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0d7e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.371028:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0d77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0d7e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330041.371084:0:9516:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788330041.371087:0:9516:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99eef6de3800 10000000:01000000:2.0:1788330041.371091:0:9516:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99eef6de3800 10000000:01000000:2.0:1788330041.371095:0:9516:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788330041.371101:0:9516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99eef6de3800 from 1 10000000:01000000:2.0:1788330041.371104:0:9516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788330041.371136:0:9516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd0d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.371145:0:9516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd0d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.371319:0:9516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd0d85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330041.371343:0:9516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792288768:0@lo:101: 00000100:00100000:2.0:1788330041.371395:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330041.371480:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70cc180 going to sleep for 11 seconds 00000100:00100000:1.0:1788330041.371714:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792288768 00000100:00100000:1.0:1788330041.371721:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792288768 00000100:00100000:1.0:1788330041.371795:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788330041.371805:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:9516:x1875199792288768:12345-0@lo:101: 00010000:00010000:1.0:1788330041.371887:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330041.371903:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec147b600/0x8475908e9fd0d8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0d85 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.371926:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec147b600/0x8475908e9fd0d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0d85 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.371937:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec147b600/0x8475908e9fd0d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0d85 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.371948:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147b600, rc 0) 00000100:00100000:1.0:1788330041.371997:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:9516:x1875199792288768:12345-0@lo:101: Request processed in 193us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330041.372004:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788330041.372071:0:9516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792288768:0@lo:101: 00010000:00010000:2.0:1788330041.372087:0:9516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd0d85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0d8c expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330041.372108:0:9516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd0d85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0d8c expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330041.372242:0:9516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792288896:0@lo:501: 00000100:00100000:2.0:1788330041.372273:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330041.372382:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70cc180 going to sleep for 11 seconds 00000100:00100000:0.0:1788330041.372424:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792288896 00000100:00100000:0.0:1788330041.372429:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792288896 00000100:00100000:0.0:1788330041.372507:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788330041.372515:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:9516:x1875199792288896:12345-0@lo:501: 00000100:00100000:0.0:1788330041.372669:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:9516:x1875199792288896:12345-0@lo:501: Request processed in 154us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330041.372676:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788330041.372759:0:9516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792288896:0@lo:501: 00000100:00100000:2.0:1788330041.372799:0:9516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792289024:0@lo:503: 00000100:00100000:2.0:1788330041.372913:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330041.372964:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70cc180 going to sleep for 11 seconds 00000100:00100000:0.0:1788330041.372997:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792289024 00000100:00100000:0.0:1788330041.373001:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792289024 00000100:00100000:0.0:1788330041.373061:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788330041.373068:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:9516:x1875199792289024:12345-0@lo:503: 00000100:00100000:0.0:1788330041.373171:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:9516:x1875199792289024:12345-0@lo:503: Request processed in 102us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330041.373177:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788330041.373258:0:9516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792289024:0@lo:503: 00000040:00080000:2.0:1788330041.373515:0:9516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788330041.373580:0:9516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792289152:0@lo:502: 00000100:00100000:2.0:1788330041.373619:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330041.373911:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70cc180 going to sleep for 11 seconds 00000100:00100000:1.0:1788330041.373937:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792289152 00000100:00100000:1.0:1788330041.373941:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792289152 00000100:00100000:1.0:1788330041.373966:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788330041.373971:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:9516:x1875199792289152:12345-0@lo:502: 00000100:00100000:1.0:1788330041.374072:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:9516:x1875199792289152:12345-0@lo:502: Request processed in 100us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330041.374077:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788330041.374514:0:9516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792289152:0@lo:502: 00000040:00080000:3.0:1788330041.375007:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788330041.375030:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788330041.375040:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788330041.375053:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788330041.375067:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788330041.375081:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788330041.375094:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788330041.375106:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788330041.375118:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788330041.375125:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788330041.375133:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788330041.375141:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788330041.375565:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788330041.375590:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788330041.375604:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788330041.375617:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788330041.375625:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788330041.375632:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788330041.375639:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788330041.375646:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788330041.375653:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788330041.375661:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788330041.375668:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788330041.375675:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788330041.375690:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788330041.375703:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788330041.375718:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788330041.375730:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788330041.375742:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788330041.375755:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788330041.375762:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788330041.375769:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788330041.375776:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788330041.375797:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788330041.375881:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788330041.375901:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788330041.375912:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1788330041.375924:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788330041.375935:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1788330041.375946:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1788330041.375957:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1788330041.375968:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1788330041.375979:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1788330041.375990:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1788330041.376015:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1788330041.376027:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1788330041.376068:0:9516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792289280:0@lo:502: 00000100:00100000:3.0:1788330041.376131:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330041.376331:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6e9ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330041.376383:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792289280 00000100:00100000:1.0:1788330041.376389:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792289280 00000100:00100000:1.0:1788330041.376533:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788330041.376543:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:9516:x1875199792289280:12345-0@lo:502: 00000100:00100000:1.0:1788330041.376700:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:9516:x1875199792289280:12345-0@lo:502: Request processed in 158us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330041.376708:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788330041.376778:0:9516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792289280:0@lo:502: 00000040:00080000:3.0:1788330041.376898:0:9516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1788330041.376908:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1788330041.377412:0:9532:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788330041.377429:0:9532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99eef6df4d28) 00000020:00000080:2.0:1788330041.377514:0:9532:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1788330041.377600:0:9532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99eef6de3800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788330041.377604:0:9532:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99eef6de3800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788330041.377607:0:9532:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eef6de3800 3 00010000:00080000:2.0:1788330041.377636:0:9532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc5f36000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.150@tcp at head 00010000:00010000:3.0:1788330041.380323:0:9532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1788330041.380994:0:9532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788330041.381050:0:9532:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788330041.381071:0:9532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8475908e9fd0d9a 00000100:00080000:3.0:1788330041.381083:0:9532:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788330041.381090:0:9532:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99edc5f36000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330041.381143:0:9532:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc5eea680 x1875199792289408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788330041.381254:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875199792289408:0@lo:38: 00000100:00100000:2.0:1788330041.381337:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788330041.381416:0:9532:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788330041.381551:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792289408 00000100:00100000:1.0:1788330041.381561:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792289408 00000100:00100000:1.0:1788330041.381604:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788330041.381613:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875199792289408:12345-0@lo:38: 00010000:00080000:1.0:1788330041.381639:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:1.0:1788330041.381673:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8475908e9fd0da1 00000004:00100000:1.0:1788330041.381693:0:6522:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788330041.381729:0:6522:0:(import.c:65:import_set_state_nolock()) ffff99edc67ec800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788330041.381997:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875199792289408:12345-0@lo:38: Request processed in 372us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330041.382005:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788330041.382425:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792289536:0@lo:400: 00000100:00100000:1.0:1788330041.382472:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330041.382504:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792290048:0@lo:400: 00000100:00100000:1.0:1788330041.382526:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330041.382549:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788330041.382555:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792289664:0@lo:400: 00000100:00100000:1.0:1788330041.382580:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330041.382599:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792290176:0@lo:400: 00000100:00100000:1.0:1788330041.382624:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330041.382650:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792289920:0@lo:400: 00000100:00100000:1.0:1788330041.382674:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330041.382701:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792290432:0@lo:400: 00000100:00100000:1.0:1788330041.382725:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330041.382744:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788330041.382750:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792289792:0@lo:400: 00000100:00100000:1.0:1788330041.382771:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330041.382800:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792290304:0@lo:400: 00000100:00100000:1.0:1788330041.382930:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330041.382965:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792289536 00000100:00100000:0.0:1788330041.382965:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792290432 00000100:00100000:1.0:1788330041.382971:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792289536 00000100:00100000:0.0:1788330041.382971:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792290432 00000100:00100000:1.0:1788330041.383001:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792290048 00000100:00100000:1.0:1788330041.383004:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792290048 00000100:00100000:0.0:1788330041.383004:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792290304 00000100:00100000:0.0:1788330041.383006:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792290304 00000100:00100000:1.0:1788330041.383018:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792290176 00000100:00100000:1.0:1788330041.383020:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792290176 00000100:00100000:0.0:1788330041.383025:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788330041.383033:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792289792 00000100:00100000:1.0:1788330041.383034:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792289792 00000100:00100000:0.0:1788330041.383039:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792290432:12345-0@lo:400: 00000100:00100000:1.0:1788330041.383045:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788330041.383050:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792289536:12345-0@lo:400: 00000100:00100000:0.0:1788330041.383087:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792290432:12345-0@lo:400: Request processed in 50us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330041.383094:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788330041.383111:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788330041.383117:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792290304:12345-0@lo:400: 00000100:00100000:3.0:1788330041.383120:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788330041.383129:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792290048:12345-0@lo:400: 00000100:00100000:0.0:1788330041.383146:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792290304:12345-0@lo:400: Request processed in 29us (216us total) trans 0 rc 0/0 00010000:00080000:2.0:1788330041.383236:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc5eea680 x1875199792289408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788330051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330041.383250:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788330041.383261:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788330041.383270:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788330041.383275:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788330041.383279:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc5f36000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788330041.383286:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875199792289408:0@lo:38: 00000100:00100000:1.0:1788330041.383620:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792289536:12345-0@lo:400: Request processed in 568us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330041.383628:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788330041.383646:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788330041.383653:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792290176:12345-0@lo:400: 00000100:00100000:0.0:1788330041.383689:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788330041.383709:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788330041.383710:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792290048:12345-0@lo:400: Request processed in 581us (1182us total) trans 0 rc 0/0 00000100:00080000:0.0:1788330041.383714:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330041.383716:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788330041.383717:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330041.383729:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788330041.383735:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792289792:12345-0@lo:400: 00000100:00100000:3.0:1788330041.383764:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792289792:12345-0@lo:400: Request processed in 30us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330041.383768:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788330041.383889:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792290176:12345-0@lo:400: Request processed in 238us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330041.383894:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788330041.383910:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792289664 00000100:00100000:1.0:1788330041.383914:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792289664 00000100:00100000:1.0:1788330041.383942:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792289920 00000100:00100000:1.0:1788330041.383945:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792289920 00000100:00100000:1.0:1788330041.383970:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788330041.383976:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792289664:12345-0@lo:400: 00000100:00100000:1.0:1788330041.384012:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792289664:12345-0@lo:400: Request processed in 36us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330041.384018:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788330041.384025:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788330041.384026:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792289920:12345-0@lo:400: 00000100:00100000:0.0:1788330041.384061:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792289920:12345-0@lo:400: Request processed in 37us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330041.384067:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792289664:0@lo:400: 00000100:00100000:0.0:1788330041.384067:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788330041.384080:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc5ee9f80 x1875199792290176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330041.384091:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792290176:0@lo:400: 00010000:00080000:1.0:1788330041.384103:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc5ee9c00 x1875199792289536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330041.384109:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792289536:0@lo:400: 00010000:00080000:1.0:1788330041.384118:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc5ee8380 x1875199792290048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330041.384123:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792290048:0@lo:400: 00010000:00080000:1.0:1788330041.384145:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc5eebb80 x1875199792289792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330041.384221:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792289792:0@lo:400: 00010000:00080000:1.0:1788330041.384236:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc5ee9880 x1875199792290304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330041.384243:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792290304:0@lo:400: 00000100:00100000:1.0:1788330041.384252:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792289920:0@lo:400: 00010000:00080000:1.0:1788330041.384263:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc5eeaa00 x1875199792290432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330041.384277:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792290432:0@lo:400: 00000020:01000004:3.0:1788330041.384497:0:9532:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788330041.384515:0:9532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff99eeffc4cd28) 00000020:00000080:3.0:1788330041.384541:0:9532:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1788330041.384623:0:9532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99eef6de3800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788330041.384626:0:9532:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99eef6de3800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788330041.384628:0:9532:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eef6de3800 3 00010000:00080000:3.0:1788330041.384656:0:9532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc655e800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.150@tcp at head 00010000:00010000:3.0:1788330041.386284:0:9532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1788330041.386479:0:9532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788330041.386522:0:9532:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788330041.386537:0:9532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x8475908e9fd0daf 00000100:00080000:3.0:1788330041.386548:0:9532:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788330041.386563:0:9532:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99edc655e800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330041.386598:0:9532:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc5ee8a80 x1875199792290560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788330041.386617:0:9532:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788330041.387064:0:9534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea0000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9534:1875199792290688:0@lo:901: 00000100:00100000:1.0:1788330041.387146:0:9534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330041.387193:0:9534:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330041.387267:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792290688 00000100:00100000:3.0:1788330041.387275:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792290688 00000100:00100000:3.0:1788330041.387335:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788330041.387345:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9534:x1875199792290688:12345-0@lo:901: 00000100:00100000:3.0:1788330041.387439:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9534:x1875199792290688:12345-0@lo:901: Request processed in 96us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330041.387447:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788330041.387503:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788330041.387536:0:9534:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eef6ea0000 x1875199792290688/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788330057 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330041.387548:0:9534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea0000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9534:1875199792290688:0@lo:901: 00000100:00100000:2.0:1788330041.390228:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875199792290560:0@lo:38: 00000100:00100000:2.0:1788330041.390321:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330041.390490:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792290560 00000100:00100000:0.0:1788330041.390499:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792290560 00000100:00100000:0.0:1788330041.390539:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788330041.390547:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875199792290560:12345-0@lo:38: 00010000:00080000:0.0:1788330041.390579:0:7832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:0.0:1788330041.390625:0:7832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x8475908e9fd0db6 00000004:00100000:0.0:1788330041.390640:0:7832:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788330041.390677:0:7832:0:(import.c:65:import_set_state_nolock()) ffff99edc70ef800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330041.390738:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875199792290560:12345-0@lo:38: Request processed in 191us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330041.390755:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788330041.390814:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc5ee8a80 x1875199792290560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788330051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330041.390826:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788330041.390836:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788330041.390842:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788330041.390847:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788330041.390850:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc655e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788330041.390857:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875199792290560:0@lo:38: 00000040:00080000:1.0:1788330041.391037:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1788330041.391116:0:9516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1788330041.391170:0:9516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788330041.391189:0:9516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd0d85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0d8c expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.391199:0:9516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd0d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0d8c expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788330041.391255:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788330041.391258:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788330041.391259:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788330041.391260:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788330041.391262:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788330041.391263:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788330041.391265:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788330041.391266:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788330041.391267:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788330041.391269:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788330041.391271:0:9516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788330041.391275:0:9516:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788330041.391277:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788330041.391282:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788330041.391283:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788330041.391284:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788330041.391285:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788330041.391286:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788330041.391287:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788330041.391287:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788330041.391288:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788330041.391289:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788330041.391290:0:9516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788330041.391312:0:9516:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788330041.391328:0:9516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792290816:0@lo:253: 00000100:00100000:0.0:1788330041.391373:0:9516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330041.391415:0:9516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec532ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788330041.391473:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792290816 00000100:00100000:1.0:1788330041.391479:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792290816 00000100:00100000:1.0:1788330041.391514:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788330041.391521:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:9516:x1875199792290816:12345-0@lo:253: 20000000:01000000:1.0:1788330041.391546:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788330041.391562:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788330041.397753:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788330041.398967:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788330041.399677:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:9516:x1875199792290816:12345-0@lo:253: Request processed in 8149us (8297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330041.399691:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788330041.399758:0:9516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b64380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9516:1875199792290816:0@lo:253: 10000000:01000000:3.0:1788330041.399772:0:9516:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788330041.399776:0:9516:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788330041.399778:0:9516:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788330041.399779:0:9516:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330041.399790:0:9516:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330041.399792:0:9516:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330041.399793:0:9516:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330041.399795:0:9516:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788330041.399796:0:9516:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788330041.399798:0:9516:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788330041.399799:0:9516:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330041.399801:0:9516:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788330041.399828:0:9516:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788330041.399855:0:6538:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788330041.399861:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00080000:10000000:3.0:1788330041.404423:0:9516:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788330041.404890:0:9516:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788330041.405085:0:9516:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788330041.405291:0:9516:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00010000:00010000:0.0:1788330041.407230:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99eef58c3600/0x8475908e9fd0dbd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.407542:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0cac expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.407551:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef58c3c00/0x8475908e9fd0cf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0cf2 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.407559:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99eef58c3600/0x8475908e9fd0dbd lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.407606:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef58c3c00/0x8475908e9fd0cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0cf2 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.407620:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eef58c3c00/0x8475908e9fd0cf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0cf2 expref: 16 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330041.407637:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b67100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875199792290944:0@lo:104: 00000100:00100000:0.0:1788330041.407823:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330041.407941:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0cac expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330041.407950:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0cb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0cac expref: 16 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330041.407958:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b67480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875199792291072:0@lo:104: 00000100:00100000:0.0:1788330041.407982:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330041.408049:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec532e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330041.408082:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792290944 00000100:00100000:1.0:1788330041.408090:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792290944 00000100:00100000:1.0:1788330041.408134:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792291072 00000100:00100000:1.0:1788330041.408138:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792291072 00000100:00100000:1.0:1788330041.408173:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330041.408184:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:6538:x1875199792290944:12345-0@lo:104: 00010000:00010000:1.0:1788330041.408207:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef58c3400/0x8475908e9fd0cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0cf9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.408267:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788330041.408274:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:6538:x1875199792290944:12345-0@lo:104: Request processed in 92us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330041.408281:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330041.408300:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788330041.408305:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:6538:x1875199792291072:12345-0@lo:104: 00010000:00010000:1.0:1788330041.408312:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0cb3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.408343:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788330041.408348:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:6538:x1875199792291072:12345-0@lo:104: Request processed in 44us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330041.408354:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788330041.408372:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788330041.408379:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef58c3400/0x8475908e9fd0cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0cf9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.408386:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c3400 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:1.0:1788330041.408391:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c3400/0x8475908e9fd0cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0cf9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.408399:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef58c3400/0x8475908e9fd0cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0cf9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788330041.408407:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c3400/0x8475908e9fd0cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0cf9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330041.408419:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788330041.408450:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef58c3400/0x8475908e9fd0cf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0cf9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.408456:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788330041.408476:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef58c3400/0x8475908e9fd0cf2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0cf9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.408484:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef58c3400/0x8475908e9fd0cf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0cf9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.408498:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330041.408501:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0cb3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.408507:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c2400 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:1.0:1788330041.408510:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0cb3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.408517:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0cb3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788330041.408523:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0cb3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330041.408528:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788330041.408540:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0cac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0cb3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.408546:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788330041.408558:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0cac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0cb3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.408564:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0cac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0cb3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.408578:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330041.408581:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330041.408583:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330041.408590:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330041.408611:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792291200:0@lo:103: 00000100:00100000:1.0:1788330041.408643:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330041.408671:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330041.408676:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792291328:0@lo:103: 00000100:00100000:1.0:1788330041.408697:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330041.408726:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792291200 00000100:00100000:1.0:1788330041.408730:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792291200 00010000:00010000:1.0:1788330041.408750:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef58c3c00/0x8475908e9fd0cf9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0cf2 expref: 17 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330041.408770:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792291328 00000100:00100000:1.0:1788330041.408773:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792291328 00010000:00010000:1.0:1788330041.408796:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0cb3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0cac expref: 18 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330041.408816:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330041.408824:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:3646:x1875199792291200:12345-0@lo:103: 00010000:00010000:1.0:1788330041.408835:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330041.408840:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef58c3c00/0x8475908e9fd0cf9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0cf2 expref: 18 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.408862:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef58c3c00/0x8475908e9fd0cf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0cf2 expref: 18 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.408879:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330041.408908:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:3646:x1875199792291200:12345-0@lo:103: Request processed in 86us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330041.408914:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330041.408928:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788330041.408934:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:3646:x1875199792291328:12345-0@lo:103: 00010000:00010000:1.0:1788330041.408942:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330041.408947:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0cb3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0cac expref: 17 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.408955:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0cb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0cac expref: 17 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.408967:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99eef58c3600/0x8475908e9fd0dbd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.408974:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef58c3600/0x8475908e9fd0dbd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788330041.408987:0:8454:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015888785s 00010000:00010000:1.0:1788330041.408992:0:8454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eef58c3600/0x8475908e9fd0dbd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.408999:0:8454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eef58c3600/0x8475908e9fd0dbd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.409006:0:8454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99eef58c3600/0x8475908e9fd0dbd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.409018:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99eef58c3600/0x8475908e9fd0dbd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.409025:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c3600 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330041.409029:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99eef58c3600/0x8475908e9fd0dbd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.409037:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99eef58c3600/0x8475908e9fd0dbd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.409045:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99eef58c3600/0x8475908e9fd0dbd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.409054:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330041.409080:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:3646:x1875199792291328:12345-0@lo:103: Request processed in 146us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330041.409086:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788330041.409128:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792291328:0@lo:103: 00000100:00100000:1.0:1788330041.409136:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792291200:0@lo:103: 00010000:00010000:1.0:1788330041.409201:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c3c00/0x8475908e9fd0cf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0cf2 expref: 16 pid: 6515 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330041.409211:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b67100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875199792290944:0@lo:104: 00010000:00010000:1.0:1788330041.409221:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0cb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0cac expref: 15 pid: 6516 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330041.409229:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b67480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1875199792291072:0@lo:104: 00010000:00010000:1.0:1788330041.409250:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99eef58c3600/0x8475908e9fd0dbd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.409260:0:6538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99eef58c3600/0x8475908e9fd0dbd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.409266:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99eef58c3600/0x8475908e9fd0dbd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330041.409271:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c3600/0x8475908e9fd0dbd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788330041.412247:0:9516:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788330041.412585:0:9516:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1788330041.417986:0:9516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788330041.441131:0:9516:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788330041.441144:0:9516:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788330041.441234:0:9516:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788330041.441293:0:9516:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788330041.441320:0:9516:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788330041.441356:0:9516:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788330041.442405:0:9516:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788330041.442614:0:9516:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:0.0:1788330042.267789:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792291456:0@lo:13: 00000100:00100000:0.0:1788330042.267898:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330042.267977:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330042.267984:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792291584:0@lo:13: 00000100:00100000:0.0:1788330042.268033:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330042.268076:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792291456 00000100:00100000:0.0:1788330042.268086:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792291456 00000100:00100000:0.0:1788330042.268134:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792291584 00000100:00100000:0.0:1788330042.268137:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792291584 00000100:00100000:0.0:1788330042.268183:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788330042.268196:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792291456:12345-0@lo:13: 00002000:00000024:0.0:1788330042.268236:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330042.268288:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792291456:12345-0@lo:13: Request processed in 95us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330042.268296:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788330042.268317:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788330042.268324:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792291584:12345-0@lo:13: 00002000:00000024:0.0:1788330042.268333:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330042.268367:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792291584:12345-0@lo:13: Request processed in 43us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330042.268374:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788330042.268521:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ef00b64000 x1875199792291584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330042.268544:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792291584:0@lo:13: 00010000:00080000:0.0:1788330042.268556:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99ef00b67800 x1875199792291456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330042.268566:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792291456:0@lo:13: 00010000:00010000:1.0:1788330042.274918:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788330042.461366:0:9588:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788330042.461658:0:9588:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788330043.291438:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788330043.291477:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792291712:0@lo:41: 00000100:00100000:3.0:1788330043.291594:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330043.291749:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792291712 00000100:00100000:0.0:1788330043.291759:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792291712 00000100:00100000:0.0:1788330043.291859:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788330043.291872:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792291712:12345-0@lo:41: 00000004:00000024:0.0:1788330043.291918:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788330043.291976:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792291712:12345-0@lo:41: Request processed in 106us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330043.291984:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788330043.292043:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792291712:0@lo:41: 00010000:00010000:0.0:1788330043.292393:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330044.317420:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330045.340398:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330045.851887:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792291840:0@lo:41: 00000100:00100000:1.0:1788330045.851991:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330045.852132:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792291840 00000100:00100000:0.0:1788330045.852144:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792291840 00000100:00100000:0.0:1788330045.852226:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788330045.852238:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792291840:12345-0@lo:41: 00000004:00000024:0.0:1788330045.852283:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788330045.852346:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792291840:12345-0@lo:41: Request processed in 111us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330045.852362:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788330045.852495:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792291840:0@lo:41: 00010000:00010000:1.0:1788330046.364584:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330046.876389:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792292224:0@lo:400: 00000100:00100000:0.0:1788330046.876508:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330046.876591:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792292736:0@lo:400: 00000100:00100000:0.0:1788330046.876619:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330046.876644:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792293248:0@lo:400: 00000100:00100000:0.0:1788330046.876664:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330046.876692:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788330046.876698:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792292352:0@lo:400: 00000100:00100000:0.0:1788330046.877914:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330046.877980:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792292864:0@lo:400: 00000100:00100000:0.0:1788330046.878018:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330046.878083:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792292224 00000100:00100000:0.0:1788330046.878095:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792292224 00000100:00100000:0.0:1788330046.878173:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788330046.878184:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792292224:12345-0@lo:400: 00000100:00100000:0.0:1788330046.878256:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792292224:12345-0@lo:400: Request processed in 74us (1749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330046.878264:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788330046.878296:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792292736 00000100:00100000:0.0:1788330046.878300:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792292736 00000100:00100000:0.0:1788330046.878343:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792293248 00000100:00100000:0.0:1788330046.878347:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792293248 00000100:00100000:0.0:1788330046.878360:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792292352 00000100:00100000:0.0:1788330046.878362:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792292352 00000100:00100000:0.0:1788330046.878389:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788330046.878395:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792292736:12345-0@lo:400: 00000100:00100000:0.0:1788330046.878432:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792292736:12345-0@lo:400: Request processed in 37us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330046.878438:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788330046.878450:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788330046.878455:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792293248:12345-0@lo:400: 00000100:00100000:0.0:1788330046.878481:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792293248:12345-0@lo:400: Request processed in 26us (1816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330046.878487:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788330046.878497:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788330046.878502:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792292352:12345-0@lo:400: 00000100:00100000:0.0:1788330046.878526:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792292352:12345-0@lo:400: Request processed in 25us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330046.878532:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788330046.878572:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792292864 00000100:00100000:0.0:1788330046.878576:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792292864 00000100:00100000:0.0:1788330046.878607:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788330046.878613:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792292864:12345-0@lo:400: 00000100:00100000:0.0:1788330046.878645:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792292864:12345-0@lo:400: Request processed in 32us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330046.878651:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788330046.878672:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788330046.878678:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788330046.879870:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792291968:0@lo:400: 00000100:00100000:2.0:1788330046.879954:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330046.880005:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792292480:0@lo:400: 00000100:00100000:2.0:1788330046.880032:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330046.880054:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792292992:0@lo:400: 00000100:00100000:2.0:1788330046.880077:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330046.880106:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788330046.880113:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792292096:0@lo:400: 00000100:00100000:2.0:1788330046.880139:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330046.880181:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792292608:0@lo:400: 00000100:00100000:2.0:1788330046.880203:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330046.880223:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792293120:0@lo:400: 00000100:00100000:2.0:1788330046.880244:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330046.880290:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792291968 00000100:00100000:2.0:1788330046.880298:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792291968 00000100:00100000:2.0:1788330046.880351:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788330046.880360:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:3648:x1875199792291968:12345-0@lo:400: 00000100:00100000:2.0:1788330046.880412:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:3648:x1875199792291968:12345-0@lo:400: Request processed in 53us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330046.880420:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788330046.880456:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792292480 00000100:00100000:2.0:1788330046.880460:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792292480 00000100:00100000:2.0:1788330046.880487:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788330046.880494:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792292480:12345-0@lo:400: 00000100:00100000:2.0:1788330046.880529:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792292480:12345-0@lo:400: Request processed in 35us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330046.880535:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788330046.880553:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792292992 00000100:00100000:2.0:1788330046.880557:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792292992 00000100:00100000:2.0:1788330046.880595:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788330046.880601:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792292992:12345-0@lo:400: 00000100:00100000:2.0:1788330046.880631:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792292992:12345-0@lo:400: Request processed in 30us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330046.880637:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788330046.880665:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792292096 00000100:00100000:2.0:1788330046.880669:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792292096 00000100:00100000:2.0:1788330046.880693:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792292608 00000100:00100000:2.0:1788330046.880696:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792292608 00000100:00100000:2.0:1788330046.880804:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792293120 00000100:00100000:2.0:1788330046.880809:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792293120 00000100:00100000:2.0:1788330046.880829:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788330046.880836:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792292096:12345-0@lo:400: 00000100:00100000:2.0:1788330046.880878:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792292096:12345-0@lo:400: Request processed in 42us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330046.880885:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788330046.880898:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788330046.880905:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792292608:12345-0@lo:400: 00000100:00100000:2.0:1788330046.880932:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792292608:12345-0@lo:400: Request processed in 28us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330046.880938:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788330046.880949:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788330046.880955:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792293120:12345-0@lo:400: 00000100:00100000:2.0:1788330046.880980:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792293120:12345-0@lo:400: Request processed in 25us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330046.880985:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788330046.881009:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788330046.881014:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788330046.881055:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ef00b64000 x1875199792292096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330046.881072:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792292096:0@lo:400: 00010000:00080000:2.0:1788330046.881085:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6d41880 x1875199792292608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330046.881093:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792292608:0@lo:400: 00010000:00080000:2.0:1788330046.881104:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6fe4380 x1875199792293120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330046.881111:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792293120:0@lo:400: 00000100:00100000:2.0:1788330046.881132:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792291968:0@lo:400: 00000100:00100000:2.0:1788330046.881143:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792292480:0@lo:400: 00010000:00080000:2.0:1788330046.881177:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6d43b80 x1875199792292992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330046.881185:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792292992:0@lo:400: 00010000:00080000:0.0:1788330046.881836:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6d41500 x1875199792292352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330046.881850:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792292352:0@lo:400: 00010000:00080000:0.0:1788330046.881884:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6d40e00 x1875199792292864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330046.881891:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792292864:0@lo:400: 00000100:00100000:0.0:1788330046.881905:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792292224:0@lo:400: 00010000:00080000:0.0:1788330046.881918:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6d40a80 x1875199792292736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330046.881925:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792292736:0@lo:400: 00010000:00080000:0.0:1788330046.881938:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6fe5f80 x1875199792293248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330046.881945:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792293248:0@lo:400: 00010000:00010000:0.0:1788330047.389592:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330047.389693:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792293376:0@lo:13: 00000100:00100000:0.0:1788330047.389803:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330047.389921:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792293376 00000100:00100000:0.0:1788330047.389931:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792293376 00000100:00100000:0.0:1788330047.389990:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788330047.390002:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792293376:12345-0@lo:13: 00002000:00000024:0.0:1788330047.390046:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330047.390250:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792293376:12345-0@lo:13: Request processed in 248us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330047.390260:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788330047.390320:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fc000 x1875199792293376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330047.390344:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792293376:0@lo:13: 00000100:00100000:2.0:1788330047.390596:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788330047.390610:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792293504:0@lo:13: 00000100:00100000:2.0:1788330047.390654:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330047.390826:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792293504 00000100:00100000:0.0:1788330047.390833:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792293504 00000100:00100000:0.0:1788330047.390873:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788330047.390881:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792293504:12345-0@lo:13: 00002000:00000024:0.0:1788330047.390894:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330047.390931:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792293504:12345-0@lo:13: Request processed in 51us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330047.390937:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788330047.390966:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc70fb800 x1875199792293504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330047.390980:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792293504:0@lo:13: 00000001:02000400:1.0:1788330047.878285:0:9878:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788330048.411978:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330048.412016:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792293632:0@lo:41: 00000100:00100000:0.0:1788330048.412121:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330048.412234:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792293632 00000100:00100000:0.0:1788330048.412245:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792293632 00000100:00100000:0.0:1788330048.412308:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788330048.412319:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792293632:12345-0@lo:41: 00000004:00000024:0.0:1788330048.412359:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788330048.412414:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792293632:12345-0@lo:41: Request processed in 96us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330048.412422:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788330048.412478:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792293632:0@lo:41: 00010000:00010000:3.0:1788330048.412688:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788330048.746521:0:9930:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788330048.748967:0:9930:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788330049.436359:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788330050.459657:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788330050.459666:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99eefe782800 from 39 10000000:01000000:1.0:1788330050.459672:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788330050.459757:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0dc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330050.459788:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0dc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330050.459937:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0dc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330050.459971:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792293760:0@lo:101: 00000100:00100000:1.0:1788330050.460070:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330050.460310:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec53fc840 going to sleep for 11 seconds 00010000:00010000:3.0:1788330050.462274:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330050.470639:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792293760 00000100:00100000:0.0:1788330050.470660:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792293760 00000100:00100000:0.0:1788330050.470752:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788330050.470763:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:6519:x1875199792293760:12345-0@lo:101: 00010000:00010000:0.0:1788330050.470809:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330050.470829:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0dcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0dc4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330050.470863:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0dcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0dc4 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330050.470875:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0dcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0dc4 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330050.470885:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c3200, rc 0) 00000100:00100000:0.0:1788330050.470981:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792293760:12345-0@lo:101: Request processed in 219us (10912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330050.470988:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788330050.471518:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792293760:0@lo:101: 00010000:00010000:1.0:1788330050.471540:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0dc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0dcb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330050.471550:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0dc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0dcb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330050.471649:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792293888:0@lo:501: 00000100:00100000:1.0:1788330050.471689:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330050.471737:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec53fc840 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.471883:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792293888 00000100:00100000:2.0:1788330050.471888:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792293888 00000100:00100000:2.0:1788330050.471928:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788330050.471936:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792293888:12345-0@lo:501: 00000100:00100000:2.0:1788330050.472079:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792293888:12345-0@lo:501: Request processed in 144us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.472086:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788330050.472258:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792293888:0@lo:501: 00000100:00100000:1.0:1788330050.472285:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792294016:0@lo:503: 00000100:00100000:1.0:1788330050.472455:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330050.472479:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec53fc840 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.472526:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792294016 00000100:00100000:2.0:1788330050.472530:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792294016 00000100:00100000:2.0:1788330050.472559:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788330050.472565:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792294016:12345-0@lo:503: 00000100:00100000:2.0:1788330050.472817:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792294016:12345-0@lo:503: Request processed in 251us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.472824:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788330050.474967:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792294016:0@lo:503: 00000100:00100000:1.0:1788330050.480501:0:9982:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9982:1875199792294144:0@lo:502: 00000100:00100000:1.0:1788330050.480604:0:9982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330050.480778:0:9982:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec53fcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788330050.486551:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792294144 00000100:00100000:0.0:1788330050.486569:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792294144 00000100:00100000:0.0:1788330050.487041:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788330050.487056:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:9982:x1875199792294144:12345-0@lo:502: 00000100:00100000:0.0:1788330050.487310:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:9982:x1875199792294144:12345-0@lo:502: Request processed in 258us (6706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330050.487331:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788330050.487436:0:9982:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9982:1875199792294144:0@lo:502: 00000100:00100000:1.0:1788330050.487506:0:9982:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9982:1875199792294272:0@lo:502: 00000100:00100000:1.0:1788330050.487552:0:9982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330050.498313:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792294272 00000100:00100000:3.0:1788330050.498530:0:9982:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.498606:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792294272 00000100:00100000:2.0:1788330050.498713:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788330050.498724:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:9982:x1875199792294272:12345-0@lo:502: 00000100:00100000:2.0:1788330050.499097:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:9982:x1875199792294272:12345-0@lo:502: Request processed in 373us (11544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.499116:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788330050.501555:0:9982:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9982:1875199792294272:0@lo:502: 00000040:00080000:3.0:1788330050.501614:0:9982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788330050.501942:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788330050.501970:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788330050.501982:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0dc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0dcb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330050.501993:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0dcb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330050.502005:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788330050.502008:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788330050.502010:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788330050.502056:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0dd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330050.502064:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0dd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330050.502072:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0dd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330050.502092:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792294400:0@lo:101: 00000100:00100000:1.0:1788330050.502191:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330050.502240:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.502507:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792294400 00000100:00100000:2.0:1788330050.502514:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792294400 00000100:00100000:2.0:1788330050.502569:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788330050.502579:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792294400:12345-0@lo:101: 00010000:00010000:2.0:1788330050.502592:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330050.502606:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ef02064000/0x8475908e9fd0dd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0dd2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.502641:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ef02064000/0x8475908e9fd0dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0dd2 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.502651:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ef02064000/0x8475908e9fd0dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0dd2 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.502659:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ef02064000, rc 0) 00000100:00100000:2.0:1788330050.502715:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792294400:12345-0@lo:101: Request processed in 138us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.502722:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788330050.503043:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792294400:0@lo:101: 00010000:00010000:1.0:1788330050.503058:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0dd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0dd9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330050.503083:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0dd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0dd9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330050.503423:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792294528:0@lo:501: 00000100:00100000:1.0:1788330050.503461:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330050.503498:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.503731:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792294528 00000100:00100000:2.0:1788330050.503737:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792294528 00000100:00100000:2.0:1788330050.503776:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788330050.503784:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792294528:12345-0@lo:501: 00000100:00100000:2.0:1788330050.503990:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792294528:12345-0@lo:501: Request processed in 207us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.504007:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788330050.504091:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792294528:0@lo:501: 00000100:00100000:3.0:1788330050.504137:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792294656:0@lo:503: 00000100:00100000:3.0:1788330050.504221:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330050.504241:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330050.504363:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792294656 00000100:00100000:0.0:1788330050.504367:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792294656 00000100:00100000:0.0:1788330050.504403:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788330050.504410:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792294656:12345-0@lo:503: 00000100:00100000:0.0:1788330050.504507:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792294656:12345-0@lo:503: Request processed in 97us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330050.504513:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788330050.505052:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792294656:0@lo:503: 00000100:00100000:3.0:1788330050.506201:0:9983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9983:1875199792294784:0@lo:502: 00000100:00100000:3.0:1788330050.506277:0:9983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330050.506553:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792294784 00000100:00100000:2.0:1788330050.506560:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792294784 00000100:00100000:2.0:1788330050.506604:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788330050.506614:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:9983:x1875199792294784:12345-0@lo:502: 00000100:00100000:2.0:1788330050.506756:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:9983:x1875199792294784:12345-0@lo:502: Request processed in 143us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.506763:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788330050.507061:0:9983:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e840 going to sleep for 11 seconds 00000100:00100000:3.0:1788330050.507086:0:9983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9983:1875199792294784:0@lo:502: 00000020:01000000:3.0:1788330050.507132:0:9983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330050.507144:0:9983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330050.507283:0:9983:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788330050.507293:0:9983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788330050.507295:0:9983:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788330050.507542:0:9983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9983:1875199792294912:0@lo:502: 00000100:00100000:3.0:1788330050.507601:0:9983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330050.507770:0:9983:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.507893:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792294912 00000100:00100000:2.0:1788330050.507900:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792294912 00000100:00100000:2.0:1788330050.507940:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788330050.507948:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:9983:x1875199792294912:12345-0@lo:502: 00000100:00100000:2.0:1788330050.508050:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:9983:x1875199792294912:12345-0@lo:502: Request processed in 103us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.508057:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788330050.508578:0:9983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9983:1875199792294912:0@lo:502: 00000020:01000000:3.0:1788330050.508609:0:9983:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330050.508616:0:9983:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330050.508618:0:9983:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788330050.508622:0:9983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788330050.508896:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788330050.508927:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788330050.508938:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0dd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0dd9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330050.508950:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0dd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0dd9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330050.508962:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788330050.508965:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99eef59c6800 from 39 10000000:01000000:0.0:1788330050.508968:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788330050.509003:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0de0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330050.509012:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0de0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330050.509021:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0de0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330050.509038:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792295040:0@lo:101: 00000100:00100000:0.0:1788330050.509081:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330050.509128:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeca581780 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.509554:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792295040 00000100:00100000:2.0:1788330050.509561:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792295040 00000100:00100000:2.0:1788330050.509600:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788330050.509609:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792295040:12345-0@lo:101: 00010000:00010000:2.0:1788330050.509620:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330050.509708:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ef02065000/0x8475908e9fd0de7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0de0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.509734:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ef02065000/0x8475908e9fd0de7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0de0 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.509746:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ef02065000/0x8475908e9fd0de7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0de0 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.509769:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ef02065000, rc 0) 00000100:00100000:2.0:1788330050.509892:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792295040:12345-0@lo:101: Request processed in 284us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.509898:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788330050.510024:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792295040:0@lo:101: 00010000:00010000:3.0:1788330050.510041:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0de0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0de7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330050.510052:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0de0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0de7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330050.510719:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792295168:0@lo:501: 00000100:00100000:3.0:1788330050.510760:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330050.510797:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788330050.511185:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792295168 00000100:00100000:1.0:1788330050.511192:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792295168 00000100:00100000:1.0:1788330050.511237:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788330050.511247:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792295168:12345-0@lo:501: 00000100:00100000:1.0:1788330050.511413:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792295168:12345-0@lo:501: Request processed in 168us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330050.511421:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788330050.515623:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792295168:0@lo:501: 00000100:00100000:3.0:1788330050.515772:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792295296:0@lo:503: 00000100:00100000:3.0:1788330050.515928:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330050.515969:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e840 going to sleep for 11 seconds 00000100:00100000:0.0:1788330050.516286:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792295296 00000100:00100000:0.0:1788330050.516293:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792295296 00000100:00100000:0.0:1788330050.516545:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788330050.516555:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792295296:12345-0@lo:503: 00000100:00100000:0.0:1788330050.516919:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792295296:12345-0@lo:503: Request processed in 365us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330050.516927:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788330050.522570:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792295296:0@lo:503: 00000100:00100000:1.0:1788330050.524036:0:9984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9984:1875199792295424:0@lo:502: 00000100:00100000:1.0:1788330050.524143:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330050.524211:0:9984:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.524345:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792295424 00000100:00100000:2.0:1788330050.524353:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792295424 00000100:00100000:2.0:1788330050.524401:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788330050.524413:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:9984:x1875199792295424:12345-0@lo:502: 00000100:00100000:2.0:1788330050.524551:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:9984:x1875199792295424:12345-0@lo:502: Request processed in 139us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.524558:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788330050.525026:0:9984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9984:1875199792295424:0@lo:502: 00000100:00100000:3.0:1788330050.525089:0:9984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9984:1875199792295552:0@lo:502: 00000100:00100000:3.0:1788330050.525133:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330050.525230:0:9984:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330050.528839:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792295552 00000100:00100000:0.0:1788330050.528857:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792295552 00000100:00100000:1.0:1788330050.529062:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788330050.529073:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:9984:x1875199792295552:12345-0@lo:502: 00000100:00100000:3.0:1788330050.529752:0:9984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9984:1875199792295552:0@lo:502: 00000040:00080000:3.0:1788330050.529812:0:9984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000100:00100000:1.0:1788330050.530060:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:9984:x1875199792295552:12345-0@lo:502: Request processed in 987us (4925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330050.530070:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000020:01000000:0.0:1788330050.530523:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788330050.530550:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788330050.530562:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0de0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0de7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330050.530576:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0de0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0de7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330050.530586:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788330050.530589:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99eef59c6800 from 6 10000000:01000000:0.0:1788330050.530592:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788330050.530707:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0dee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330050.530716:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0dee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330050.530727:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0dee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330050.530748:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792295680:0@lo:101: 00000100:00100000:0.0:1788330050.530796:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330050.530907:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eed3541780 going to sleep for 11 seconds 00000100:00100000:1.0:1788330050.530970:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792295680 00000100:00100000:1.0:1788330050.530977:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792295680 00000100:00100000:1.0:1788330050.531062:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788330050.531071:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792295680:12345-0@lo:101: 00010000:00010000:1.0:1788330050.531109:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330050.531124:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec147a400/0x8475908e9fd0df5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0dee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330050.531187:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec147a400/0x8475908e9fd0df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0dee expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330050.531198:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec147a400/0x8475908e9fd0df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0dee expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330050.531207:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147a400, rc 0) 00000100:00100000:1.0:1788330050.531240:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:6519:x1875199792295680:12345-0@lo:101: Request processed in 171us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330050.531246:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788330050.531333:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792295680:0@lo:101: 00010000:00010000:0.0:1788330050.531348:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0dee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0df5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330050.531357:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0dee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0df5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330050.531411:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792295808:0@lo:256: 00000100:00100000:0.0:1788330050.531443:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330050.539693:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eed3541780 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.543622:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792295808 00000100:00100000:2.0:1788330050.543731:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792295808 00000100:00100000:2.0:1788330050.543879:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788330050.543891:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:6519:x1875199792295808:12345-0@lo:256: 20000000:01000000:2.0:1788330050.543922:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788330050.543954:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788330050.543957:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788330050.544775:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:6519:x1875199792295808:12345-0@lo:256: Request processed in 883us (13327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.544785:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788330050.552423:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792295808:0@lo:256: 10000000:01000000:0.0:1788330050.552515:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788330050.552528:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0dee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0df5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330050.552539:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0dee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0df5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330050.552550:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788330050.552553:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1788330050.552556:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788330050.552599:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c3c00/0x8475908e9fd0dfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330050.552607:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef58c3c00/0x8475908e9fd0dfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330050.552616:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef58c3c00/0x8475908e9fd0dfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330050.552636:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792295936:0@lo:101: 00000100:00100000:0.0:1788330050.552713:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330050.552753:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec532ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788330050.552850:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792295936 00000100:00100000:1.0:1788330050.552858:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792295936 00000100:00100000:1.0:1788330050.552911:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788330050.552922:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:6519:x1875199792295936:12345-0@lo:101: 00010000:00010000:1.0:1788330050.552935:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330050.552948:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec147b200/0x8475908e9fd0e03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0dfc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330050.552973:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec147b200/0x8475908e9fd0e03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0dfc expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330050.552985:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec147b200/0x8475908e9fd0e03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0dfc expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330050.552994:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147b200, rc 0) 00000100:00100000:1.0:1788330050.553053:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792295936:12345-0@lo:101: Request processed in 132us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330050.553060:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788330050.553514:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792295936:0@lo:101: 00010000:00010000:0.0:1788330050.553537:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef58c3c00/0x8475908e9fd0dfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0e03 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330050.553546:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef58c3c00/0x8475908e9fd0dfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0e03 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330050.553607:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792296064:0@lo:501: 00000100:00100000:0.0:1788330050.553635:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330050.553724:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec532ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.559475:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792296064 00000100:00100000:2.0:1788330050.559493:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792296064 00000100:00100000:2.0:1788330050.559569:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788330050.559580:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792296064:12345-0@lo:501: 00000100:00100000:2.0:1788330050.560044:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792296064:12345-0@lo:501: Request processed in 464us (6407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.560075:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788330050.572514:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792296064:0@lo:501: 00000100:00100000:1.0:1788330050.573374:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792296192:0@lo:503: 00000100:00100000:1.0:1788330050.573465:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330050.573515:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.574337:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792296192 00000100:00100000:2.0:1788330050.574348:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792296192 00000100:00100000:2.0:1788330050.574406:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788330050.574415:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792296192:12345-0@lo:503: 00000100:00100000:2.0:1788330050.574620:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792296192:12345-0@lo:503: Request processed in 205us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.574628:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788330050.574808:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792296192:0@lo:503: 00000100:00100000:3.0:1788330050.582011:0:9985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9985:1875199792296320:0@lo:502: 00000100:00100000:3.0:1788330050.582138:0:9985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330050.582380:0:9985:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.591539:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792296320 00000100:00100000:2.0:1788330050.591559:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792296320 00000100:00100000:2.0:1788330050.593238:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788330050.593267:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:9985:x1875199792296320:12345-0@lo:502: 00000100:00100000:2.0:1788330050.593653:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:9985:x1875199792296320:12345-0@lo:502: Request processed in 398us (11513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.593661:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788330050.593805:0:9985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9985:1875199792296320:0@lo:502: 00000020:01000000:3.0:1788330050.593843:0:9985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788330050.593850:0:9985:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788330050.593858:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330050.593860:0:9985:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788330050.593865:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788330050.593869:0:9985:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:01000000:3.0:1788330050.593896:0:9985:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788330050.593899:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788330050.593917:0:9985:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff99eeffc48000) 00000020:00000080:3.0:1788330050.593943:0:9985:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788330050.593950:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788330050.594045:0:9985:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788330050.594052:0:9985:0:(osd_handler.c:8927:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788330050.594060:0:9985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8475908e9fd0e11 00010000:00080000:3.0:1788330050.594090:0:9985:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc75d7800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.150@tcp at head 00010000:00010000:3.0:1788330050.594389:0:9985:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1788330050.594529:0:9985:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788330050.594542:0:9985:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788330050.594747:0:9985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788330050.594865:0:9985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788330050.595021:0:9985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788330050.595112:0:9985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000020:00000080:0.0:1788330050.603958:0:9985:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788330050.603978:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788330050.604023:0:9985:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788330050.604054:0:9985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd0e18 00000100:00080000:0.0:1788330050.604066:0:9985:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788330050.604074:0:9985:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99edc75d7800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:0.0:1788330050.604124:0:9985:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc72fed80 x1875199792296448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788330050.604428:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792296448:0@lo:8: 00000100:00100000:0.0:1788330050.604501:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330050.604567:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792296448 00000100:00100000:0.0:1788330050.604575:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792296448 00000100:00100000:0.0:1788330050.604606:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788330050.604615:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875199792296448:12345-0@lo:8: 00010000:00080000:0.0:1788330050.604642:0:8437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:0.0:1788330050.604668:0:8437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd0e1f 00002000:00100000:0.0:1788330050.604681:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff99edc75d4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788330050.604705:0:8437:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1788330050.604710:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788330050.604777:0:8437:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788330050.605021:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788330050.605047:0:8437:0:(import.c:65:import_set_state_nolock()) ffff99eedfe1f000 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1788330050.605241:0:9986:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788330050.605247:0:9986:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1788330050.606286:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875199792296448:12345-0@lo:8: Request processed in 482us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330050.606303:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788330050.608453:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fed80 x1875199792296448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788330060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330050.608470:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788330050.608481:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788330050.608490:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788330050.608497:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788330050.608501:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc75d7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788330050.608524:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788330050.608531:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792296448:0@lo:8: 00000100:00080000:0.0:1788330050.608571:0:9985:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000004:00080000:3.0:1788330050.608692:0:9986:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788330050.608831:0:9986:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 254580679619ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788330050.608838:0:9986:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0001: async commit OSD 00000020:01000000:0.0:1788330050.609449:0:9985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788330050.609457:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330050.609459:0:9985:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788330050.609462:0:9985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788330050.609467:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330050.609469:0:9985:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788330050.609471:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788330050.609474:0:9985:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788330050.609516:0:9985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9985:1875199792296576:0@lo:502: 00000100:00100000:0.0:1788330050.609623:0:9985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330050.609671:0:9985:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec532e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330050.609717:0:9987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9987:1875199792296704:0@lo:700: 00000100:00100000:0.0:1788330050.609746:0:9987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330050.609763:0:9987:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec532eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.611630:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792296704 00000100:00100000:2.0:1788330050.611646:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792296704 00000100:00100000:2.0:1788330050.611746:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788330050.611758:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9987:x1875199792296704:12345-0@lo:700: 00000100:00100000:2.0:1788330050.611813:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8447:1875199792296832:0@lo:700: 00000100:00100000:2.0:1788330050.611873:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330050.611902:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10a5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.611924:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792296832 00000100:00100000:2.0:1788330050.611928:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792296832 00000100:00100000:2.0:1788330050.611958:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788330050.611966:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8447:x1875199792296832:12345-0@lo:700: 00000100:00100000:2.0:1788330050.612110:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792296576 00000100:00100000:2.0:1788330050.612114:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792296576 00000100:00100000:2.0:1788330050.612188:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788330050.612197:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:9985:x1875199792296576:12345-0@lo:502: 00000100:00100000:2.0:1788330050.612346:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:9985:x1875199792296576:12345-0@lo:502: Request processed in 149us (2723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.612354:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788330050.612417:0:9985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9985:1875199792296576:0@lo:502: 00000020:01000000:2.0:1788330050.612451:0:9985:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330050.612458:0:9985:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330050.612460:0:9985:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788330050.612465:0:9985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00080000:0.0:1788330050.616709:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330050.616724:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:01000000:0.0:1788330050.616776:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1788330050.616820:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788330050.616834:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c3c00/0x8475908e9fd0dfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0e03 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330050.616847:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef58c3c00/0x8475908e9fd0dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0e03 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330050.616860:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788330050.616863:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99eec865b000 from 39 10000000:01000000:0.0:1788330050.616866:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788330050.616912:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0e26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330050.616920:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0e26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330050.616931:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0e26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330050.616956:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792296960:0@lo:101: 00000100:00100000:0.0:1788330050.617034:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330050.617088:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec532e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.617307:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792296960 00000100:00100000:2.0:1788330050.617316:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792296960 00000100:00100000:2.0:1788330050.617381:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788330050.617392:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792296960:12345-0@lo:101: 00010000:00010000:2.0:1788330050.617405:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330050.617419:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0e2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0e26 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.617444:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0e26 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.617454:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0e26 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.617463:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ef02065c00, rc 0) 00000100:00100000:2.0:1788330050.617505:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792296960:12345-0@lo:101: Request processed in 115us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.617531:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788330050.617578:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792296960:0@lo:101: 00010000:00010000:2.0:1788330050.617592:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0e26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0e2d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.617601:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0e26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0e2d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330050.617674:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792297088:0@lo:501: 00000100:00100000:2.0:1788330050.617712:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330050.617731:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76ae540 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.617746:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792297088 00000100:00100000:2.0:1788330050.617749:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792297088 00000100:00100000:2.0:1788330050.617775:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788330050.617781:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792297088:12345-0@lo:501: 00000100:00100000:2.0:1788330050.617897:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792297088:12345-0@lo:501: Request processed in 116us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.617904:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788330050.617932:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792297088:0@lo:501: 00000100:00100000:2.0:1788330050.617958:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792297216:0@lo:503: 00000100:00100000:2.0:1788330050.617999:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330050.618011:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76ae540 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.618021:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792297216 00000100:00100000:2.0:1788330050.618025:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792297216 00000100:00100000:2.0:1788330050.618041:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788330050.618047:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792297216:12345-0@lo:503: 00000100:00100000:2.0:1788330050.618145:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792297216:12345-0@lo:503: Request processed in 97us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.618181:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788330050.618223:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792297216:0@lo:503: 00000100:00100000:2.0:1788330050.618432:0:9988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9988:1875199792297344:0@lo:502: 00000100:00100000:2.0:1788330050.618463:0:9988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330050.618482:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792297344 00000100:00100000:2.0:1788330050.618485:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792297344 00000100:00100000:2.0:1788330050.618508:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788330050.618514:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:9988:x1875199792297344:12345-0@lo:502: 00000100:00100000:2.0:1788330050.618584:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:9988:x1875199792297344:12345-0@lo:502: Request processed in 69us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.618590:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788330050.618624:0:9988:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76aee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.618635:0:9988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9988:1875199792297344:0@lo:502: 00000100:00100000:2.0:1788330050.618675:0:9988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9988:1875199792297472:0@lo:502: 00000100:00100000:2.0:1788330050.618718:0:9988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330050.618735:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792297472 00000100:00100000:2.0:1788330050.618739:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792297472 00000100:00100000:2.0:1788330050.618764:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788330050.618769:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:9988:x1875199792297472:12345-0@lo:502: 00000100:00100000:2.0:1788330050.618822:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:9988:x1875199792297472:12345-0@lo:502: Request processed in 53us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.618828:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788330050.618854:0:9988:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76aee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.618871:0:9988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9988:1875199792297472:0@lo:502: 00000040:00080000:2.0:1788330050.618887:0:9988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788330050.618934:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788330050.618950:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788330050.618957:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0e26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0e2d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.618966:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0e2d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330050.618975:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788330050.618977:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99eec865b000 from 6 10000000:01000000:2.0:1788330050.618980:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788330050.618999:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd0e34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.619006:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd0e34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.619013:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd0e34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330050.619024:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792297600:0@lo:101: 00000100:00100000:2.0:1788330050.619048:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330050.619061:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76aee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.619073:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792297600 00000100:00100000:2.0:1788330050.619076:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792297600 00000100:00100000:2.0:1788330050.619097:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788330050.619102:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792297600:12345-0@lo:101: 00010000:00010000:2.0:1788330050.619110:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330050.619125:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99ef02064200/0x8475908e9fd0e3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0e34 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.619142:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99ef02064200/0x8475908e9fd0e3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0e34 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.619180:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99ef02064200/0x8475908e9fd0e3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0e34 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.619188:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ef02064200, rc 0) 00000100:00100000:2.0:1788330050.619217:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792297600:12345-0@lo:101: Request processed in 115us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.619222:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788330050.619249:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792297600:0@lo:101: 00010000:00010000:2.0:1788330050.619259:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd0e34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0e3b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.619268:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd0e34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0e3b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330050.619307:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792297728:0@lo:256: 00000100:00100000:2.0:1788330050.619335:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330050.619353:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76aee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.619363:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792297728 00000100:00100000:2.0:1788330050.619366:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792297728 00000100:00100000:2.0:1788330050.619388:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788330050.619395:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792297728:12345-0@lo:256: 20000000:01000000:2.0:1788330050.619407:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788330050.619424:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788330050.619431:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788330050.619507:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792297728:12345-0@lo:256: Request processed in 112us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.619515:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788330050.619542:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792297728:0@lo:256: 10000000:01000000:2.0:1788330050.619583:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788330050.619589:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd0e34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0e3b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.619597:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd0e34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0e3b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330050.619603:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788330050.619605:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788330050.619607:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788330050.619632:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765b200/0x8475908e9fd0e42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.619639:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99edc765b200/0x8475908e9fd0e42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.619645:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99edc765b200/0x8475908e9fd0e42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330050.619656:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792297856:0@lo:101: 00000100:00100000:2.0:1788330050.619679:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330050.619692:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76aee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.619715:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792297856 00000100:00100000:2.0:1788330050.619720:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792297856 00000100:00100000:2.0:1788330050.619739:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788330050.619754:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792297856:12345-0@lo:101: 00010000:00010000:2.0:1788330050.619760:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330050.619768:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99edc765a400/0x8475908e9fd0e49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0e42 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.619782:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99edc765a400/0x8475908e9fd0e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0e42 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.619791:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99edc765a400/0x8475908e9fd0e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0e42 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.619798:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99edc765a400, rc 0) 00000100:00100000:2.0:1788330050.619824:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792297856:12345-0@lo:101: Request processed in 72us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.619830:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788330050.619860:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792297856:0@lo:101: 00010000:00010000:2.0:1788330050.619869:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99edc765b200/0x8475908e9fd0e42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0e49 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330050.619878:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99edc765b200/0x8475908e9fd0e42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0e49 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330050.619920:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792297984:0@lo:501: 00000100:00100000:2.0:1788330050.619943:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330050.619954:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76aee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.619964:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792297984 00000100:00100000:2.0:1788330050.619968:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792297984 00000100:00100000:2.0:1788330050.619987:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788330050.619992:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792297984:12345-0@lo:501: 00000100:00100000:2.0:1788330050.620091:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792297984:12345-0@lo:501: Request processed in 98us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.620098:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788330050.620128:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792297984:0@lo:501: 00000100:00100000:2.0:1788330050.620178:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792298112:0@lo:503: 00000100:00100000:2.0:1788330050.620211:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330050.620229:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76aee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.620240:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792298112 00000100:00100000:2.0:1788330050.620243:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792298112 00000100:00100000:2.0:1788330050.620263:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788330050.620269:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792298112:12345-0@lo:503: 00000100:00100000:2.0:1788330050.620340:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792298112:12345-0@lo:503: Request processed in 71us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.620347:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788330050.620385:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792298112:0@lo:503: 00000100:00100000:1.0:1788330050.625269:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330050.625300:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792298240:0@lo:400: 00000100:00100000:1.0:1788330050.625514:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330050.625579:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792298240 00000100:00100000:1.0:1788330050.625587:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792298240 00000100:00100000:1.0:1788330050.625643:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788330050.625653:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792298240:12345-0@lo:400: 00000100:00100000:1.0:1788330050.625718:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792298240:12345-0@lo:400: Request processed in 66us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330050.625726:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788330050.625768:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef58cad80 x1875199792298240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330050.625782:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792298240:0@lo:400: 00000100:00100000:1.0:1788330050.625821:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792298368:0@lo:400: 00000100:00100000:1.0:1788330050.625848:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330050.625878:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792298368 00000100:00100000:1.0:1788330050.625882:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792298368 00000100:00100000:1.0:1788330050.625907:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788330050.625913:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792298368:12345-0@lo:400: 00000100:00100000:1.0:1788330050.625948:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792298368:12345-0@lo:400: Request processed in 36us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330050.625975:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788330050.626003:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792298368:0@lo:400: 00000100:00100000:1.0:1788330050.626039:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792298496:0@lo:400: 00000100:00100000:1.0:1788330050.626081:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330050.629676:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792298496 00000100:00100000:1.0:1788330050.629691:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792298496 00000100:00100000:1.0:1788330050.629781:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788330050.629792:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792298496:12345-0@lo:400: 00000100:00100000:1.0:1788330050.629892:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792298496:12345-0@lo:400: Request processed in 102us (3809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330050.629900:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788330050.629944:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6ea3100 x1875199792298496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330050.629959:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792298496:0@lo:400: 00000100:00100000:1.0:1788330050.630013:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792298624:0@lo:400: 00000100:00100000:1.0:1788330050.630048:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330050.630079:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792298624 00000100:00100000:1.0:1788330050.630082:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792298624 00000100:00100000:0.0:1788330050.630260:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792298752:0@lo:400: 00000100:00100000:0.0:1788330050.630307:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330050.630356:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330050.630362:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792298880:0@lo:400: 00000100:00100000:0.0:1788330050.630381:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330050.630436:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792299264:0@lo:400: 00000100:00100000:0.0:1788330050.630455:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330050.630496:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792298752 00000100:00100000:0.0:1788330050.630499:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792298752 00000100:00100000:0.0:1788330050.630528:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792298880 00000100:00100000:0.0:1788330050.630530:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792298880 00000100:00100000:0.0:1788330050.630540:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792299264 00000100:00100000:0.0:1788330050.630542:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792299264 00000100:00100000:0.0:1788330050.630553:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788330050.630559:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792298752:12345-0@lo:400: 00000100:00100000:0.0:1788330050.630588:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792298752:12345-0@lo:400: Request processed in 30us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330050.630594:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788330050.630607:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788330050.630612:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792298880:12345-0@lo:400: 00000100:00100000:0.0:1788330050.630635:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792298880:12345-0@lo:400: Request processed in 23us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330050.630640:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788330050.630649:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788330050.630654:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792299264:12345-0@lo:400: 00000100:00100000:0.0:1788330050.630672:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792299264:12345-0@lo:400: Request processed in 18us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330050.630677:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788330050.630721:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788330050.630728:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792298624:12345-0@lo:400: 00000100:00100000:0.0:1788330050.630759:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792298624:12345-0@lo:400: Request processed in 32us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330050.630765:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788330050.630779:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788330050.630783:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788330050.630801:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72ff480 x1875199792299264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330050.630811:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792299264:0@lo:400: 00010000:00080000:0.0:1788330050.630821:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fd500 x1875199792298880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330050.630828:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792298880:0@lo:400: 00010000:00080000:0.0:1788330050.630837:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fc700 x1875199792298752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330050.630846:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792298752:0@lo:400: 00000100:00100000:0.0:1788330050.630878:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792299136:0@lo:400: 00000100:00100000:0.0:1788330050.630902:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330050.630926:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792298624:0@lo:400: 00000100:00100000:0.0:1788330050.630935:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330050.630940:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792299008:0@lo:400: 00000100:00100000:0.0:1788330050.630958:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788330050.637512:0:7454:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788330050.641557:0:9989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9989:1875199792299392:0@lo:502: 00000100:00100000:3.0:1788330050.641655:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330050.641676:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792299136 00000100:00100000:2.0:1788330050.641684:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792299136 00000100:00100000:3.0:1788330050.641710:0:9989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.641760:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792299008 00000100:00100000:2.0:1788330050.641763:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792299008 00000100:00100000:2.0:1788330050.641790:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788330050.641799:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792299136:12345-0@lo:400: 00000100:00100000:2.0:1788330050.641943:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792299136:12345-0@lo:400: Request processed in 144us (11039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.641951:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788330050.642140:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788330050.642148:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792299008:12345-0@lo:400: 00000100:00100000:2.0:1788330050.642259:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792299008:12345-0@lo:400: Request processed in 112us (11299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.642265:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788330050.642335:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fdf80 x1875199792299008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330050.642351:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792299008:0@lo:400: 00010000:00080000:2.0:1788330050.642366:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fd880 x1875199792299136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330050.642375:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792299136:0@lo:400: 00000100:00080000:2.0:1788330050.642404:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330050.642417:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792299392 00000100:00100000:2.0:1788330050.642422:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792299392 00000100:00100000:2.0:1788330050.642461:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788330050.642469:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:9989:x1875199792299392:12345-0@lo:502: 00000100:00100000:2.0:1788330050.642593:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:9989:x1875199792299392:12345-0@lo:502: Request processed in 125us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.642600:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788330050.642718:0:9989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9989:1875199792299392:0@lo:502: 00000020:01000000:3.0:1788330050.642747:0:9989:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788330050.642756:0:9989:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788330050.642840:0:9989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330050.642843:0:9989:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788330050.642849:0:9989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788330050.642853:0:9989:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:01000000:3.0:1788330050.642878:0:9989:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788330050.642881:0:9989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788330050.642895:0:9989:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99eeffc4b370) 00000020:00000080:3.0:1788330050.642920:0:9989:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1788330050.642926:0:9989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788330050.643026:0:9989:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788330050.643033:0:9989:0:(osd_handler.c:8927:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788330050.643314:0:9989:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd0e57 00010000:00080000:3.0:1788330050.651732:0:9989:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc759d800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.150@tcp at head 00010000:00010000:3.0:1788330050.652075:0:9989:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 40000000:02000000:0.0:1788330050.659048:0:6529:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000040:01000000:3.0:1788330050.663779:0:9989:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788330050.663808:0:9989:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788330050.664009:0:9989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788330050.664442:0:9989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788330050.664586:0:9989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788330050.664691:0:9989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788330050.666038:0:9990:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788330050.666045:0:9990:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788330050.667006:0:9989:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788330050.667019:0:9989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788330050.667063:0:9989:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788330050.667092:0:9989:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd0e5e 00000100:00080000:3.0:1788330050.667393:0:9989:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788330050.667399:0:9989:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99edc759d800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330050.667547:0:9989:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc76ddf80 x1875199792299520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788330050.667578:0:9989:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788330050.667639:0:9989:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330050.667644:0:9989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330050.667646:0:9989:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788330050.667650:0:9989:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330050.667654:0:9989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330050.667664:0:9989:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788330050.667668:0:9989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788330050.667670:0:9989:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788330050.667712:0:9989:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9989:1875199792299648:0@lo:502: 00000100:00100000:1.0:1788330050.667799:0:9989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330050.667841:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792299648 00000100:00100000:1.0:1788330050.667848:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792299648 00000100:00100000:1.0:1788330050.667892:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788330050.667902:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:9989:x1875199792299648:12345-0@lo:502: 00000100:00100000:1.0:1788330050.668027:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:9989:x1875199792299648:12345-0@lo:502: Request processed in 125us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330050.668034:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788330050.668087:0:9989:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eecaf9af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788330050.668120:0:9989:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:9989:1875199792299648:0@lo:502: 00000020:01000000:1.0:1788330050.668147:0:9989:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330050.668228:0:9989:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330050.668230:0:9989:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788330050.668234:0:9989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:1.0:1788330050.668308:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1788330050.668347:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788330050.668358:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765b200/0x8475908e9fd0e42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0e49 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330050.668368:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99edc765b200/0x8475908e9fd0e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0e49 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330050.668378:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788330050.668381:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99eee7570000 from 1 10000000:01000000:1.0:1788330050.668384:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788330050.668414:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd0e65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330050.668423:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd0e65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330050.668432:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd0e65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330050.668446:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792299776:0@lo:101: 00000100:00100000:1.0:1788330050.668476:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330050.668496:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec53fc840 going to sleep for 11 seconds 00000100:00100000:0.0:1788330050.670044:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792299520:0@lo:8: 00000100:00100000:0.0:1788330050.670194:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330050.670292:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792299776 00000100:00100000:0.0:1788330050.670303:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792299776 00000100:00100000:0.0:1788330050.670363:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788330050.670373:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792299776:12345-0@lo:101: 00010000:00010000:0.0:1788330050.670394:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330050.670417:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef58c3400/0x8475908e9fd0e6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0e65 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330050.670458:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef58c3400/0x8475908e9fd0e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0e65 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330050.670465:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792299520 00010000:00010000:0.0:1788330050.670474:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef58c3400/0x8475908e9fd0e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0e65 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330050.670482:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792299520 00010000:00010000:0.0:1788330050.670490:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c3400, rc 0) 00000100:00100000:3.0:1788330050.670546:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788330050.670556:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3645:x1875199792299520:12345-0@lo:8: 00010000:00080000:3.0:1788330050.670595:0:8632:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:3.0:1788330050.670631:0:8632:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd0e73 00002000:00100000:3.0:1788330050.670647:0:8632:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99edc7707000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788330050.670652:0:8632:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788330050.670655:0:8632:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788330050.670757:0:8632:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788330050.670786:0:8632:0:(import.c:65:import_set_state_nolock()) ffff99edc7703000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788330050.670871:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1875199792299520:12345-0@lo:8: Request processed in 314us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330050.670879:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788330050.671376:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792299776:12345-0@lo:101: Request processed in 999us (2893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330050.671387:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00010000:00080000:0.0:1788330050.671483:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc76ddf80 x1875199792299520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788330060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330050.671486:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792299776:0@lo:101: 00000100:00100000:0.0:1788330050.671513:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788330050.671524:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00010000:00010000:1.0:1788330050.671527:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd0e65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0e6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788330050.671535:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00010000:00010000:1.0:1788330050.671544:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd0e65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0e6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788330050.671545:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00100000:1.0:1788330050.671627:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792299904:0@lo:501: 00000100:00100000:1.0:1788330050.671672:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330050.671716:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec53fc840 going to sleep for 11 seconds 00000100:00100000:3.0:1788330050.671785:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792299904 00000100:00100000:3.0:1788330050.671791:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792299904 00000100:00100000:3.0:1788330050.671833:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788330050.671841:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792299904:12345-0@lo:501: 00000100:00100000:3.0:1788330050.671936:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792299904:12345-0@lo:501: Request processed in 95us (263us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788330050.671943:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788330050.672017:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792299904:0@lo:501: 10000000:01000000:1.0:1788330050.672046:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788330050.672053:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd0e65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0e6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330050.672062:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd0e65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0e6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330050.672261:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8447:x1875199792296832:12345-0@lo:700: Request processed in 60295us (60386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330050.672270:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788330050.672457:0:8447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc70faa00 x1875199792296832/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788330066 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330050.672468:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8447:1875199792296832:0@lo:700: 40000000:02000000:3.0:1788330050.672477:0:8447:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00080000:0.0:1788330050.672664:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc759d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788330050.672714:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788330050.672724:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792299520:0@lo:8: 00000004:00080000:0.0:1788330050.672907:0:9990:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788330050.673241:0:9990:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 254645089023ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788330050.673249:0:9990:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788330050.678638:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788330050.678852:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330050.678885:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792300032:0@lo:13: 00000100:00100000:1.0:1788330050.679121:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788330050.679210:0:9991:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788330050.679229:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792300032 00000100:00100000:1.0:1788330050.679242:0:9991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76dce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9991:1875199792300160:0@lo:7: 00000100:00100000:2.0:1788330050.679243:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792300032 00000100:00100000:1.0:1788330050.679285:0:9991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330050.679312:0:9991:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec53fc840 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.679347:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788330050.679359:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792300032:12345-0@lo:13: 00002000:00000024:2.0:1788330050.679422:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1788330050.679516:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792300032:12345-0@lo:13: Request processed in 160us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.679524:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788330050.679560:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788330050.679573:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792300160 00000100:00100000:2.0:1788330050.679577:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792300160 00000100:00100000:2.0:1788330050.679604:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788330050.679611:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9991:x1875199792300160:12345-0@lo:7: 00010000:00080000:1.0:1788330050.680070:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc76dd880 x1875199792300032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330050.680100:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792300032:0@lo:13: 00000001:00100000:3.0:1788330050.709343:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788330050.709361:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788330050.710671:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9987:x1875199792296704:12345-0@lo:700: Request processed in 98903us (100911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330050.710706:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788330050.710896:0:9987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fca80 x1875199792296704/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788330066 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330050.710913:0:9987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9987:1875199792296704:0@lo:700: 00002000:00080000:0.0:1788330050.715205:0:8440:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788330050.715220:0:8440:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788330050.715357:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9991:x1875199792300160:12345-0@lo:7: Request processed in 35739us (36068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330050.715371:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788330050.715471:0:9991:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc76dce00 x1875199792300160/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788330066 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330050.715492:0:9991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76dce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9991:1875199792300160:0@lo:7: 00000004:00080000:2.0:1788330050.715511:0:9991:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788330050.715564:0:9991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9991:1875199792300288:0@lo:5: 00000100:00100000:2.0:1788330050.715630:0:9991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330050.715661:0:9991:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76aec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788330050.716269:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792300288 00000100:00100000:0.0:1788330050.716283:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792300288 00000100:00100000:0.0:1788330050.716341:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788330050.716353:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9991:x1875199792300288:12345-0@lo:5: 00000004:00080000:2.0:1788330050.716959:0:9987:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788330050.717012:0:9987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9987:1875199792300544:0@lo:7: 00000100:00100000:2.0:1788330050.717066:0:9987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330050.717101:0:9987:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76ae780 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.717114:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788330050.717127:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792300416:0@lo:13: 00000100:00100000:2.0:1788330050.717183:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330050.717211:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792300416 00000100:00100000:2.0:1788330050.717218:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792300416 00000100:00100000:2.0:1788330050.717261:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788330050.717270:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792300416:12345-0@lo:13: 00002000:00000024:2.0:1788330050.717290:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1788330050.717595:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792300416:12345-0@lo:13: Request processed in 324us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330050.717603:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788330050.717652:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc70fa680 x1875199792300416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330050.717671:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792300416:0@lo:13: 00002000:00080000:0.0:1788330050.717771:0:8632:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788330050.717779:0:8632:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788330050.718287:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9991:x1875199792300288:12345-0@lo:5: Request processed in 1931us (2652us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788330050.718299:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788330050.718331:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792300544 00000100:00100000:0.0:1788330050.718340:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792300544 00000100:00100000:0.0:1788330050.718391:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788330050.718401:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9987:x1875199792300544:12345-0@lo:7: 00010000:00080000:2.0:1788330050.720038:0:9991:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc70f9180 x1875199792300288/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788330066 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330050.720066:0:9991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9991:1875199792300288:0@lo:5: 00000004:00080000:2.0:1788330050.720085:0:9991:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788330050.720144:0:9991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70fa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9991:1875199792300672:0@lo:700: 00000100:00100000:2.0:1788330050.720233:0:9991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330050.720269:0:9991:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76aec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788330050.720334:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792300672 00000100:00100000:3.0:1788330050.720343:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792300672 00000100:00100000:3.0:1788330050.720402:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788330050.720416:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9991:x1875199792300672:12345-0@lo:700: 00000001:00080000:2.0:1788330050.730360:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:2.0:1788330050.730771:0:9991:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc70fa680 x1875199792300672/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788330066 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330050.730785:0:9991:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788330050.730803:0:9991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70fa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9991:1875199792300672:0@lo:700: 00000100:00100000:3.0:1788330050.731000:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9991:x1875199792300672:12345-0@lo:700: Request processed in 10585us (10767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330050.731013:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00002000:00080000:1.0:1788330050.732978:0:8632:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788330050.732990:0:8632:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00010000:00080000:2.0:1788330050.733214:0:9987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc70f9c00 x1875199792300544/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788330066 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330050.733269:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9987:x1875199792300544:12345-0@lo:7: Request processed in 14692us (16024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330050.733283:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788330050.733492:0:9987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9987:1875199792300544:0@lo:7: 00000004:00080000:2.0:1788330050.733510:0:9987:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788330050.733559:0:9987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9987:1875199792300800:0@lo:5: 00000100:00100000:2.0:1788330050.733602:0:9987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330050.733635:0:9987:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76ae780 going to sleep for 11 seconds 00000100:00100000:0.0:1788330050.738618:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792300800 00000100:00100000:0.0:1788330050.738652:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792300800 00000100:00100000:0.0:1788330050.738750:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788330050.738762:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9987:x1875199792300800:12345-0@lo:5: 00002000:00080000:0.0:1788330050.738825:0:8439:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788330050.738950:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9987:x1875199792300800:12345-0@lo:5: Request processed in 190us (5346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330050.738959:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788330050.739242:0:9987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc70f9c00 x1875199792300800/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788330066 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330050.739279:0:9987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9987:1875199792300800:0@lo:5: 00000004:00080000:2.0:1788330050.739295:0:9987:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788330050.739412:0:9987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9987:1875199792300928:0@lo:5: 00000100:00100000:0.0:1788330050.739467:0:9987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330050.739544:0:9987:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec532e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330050.739582:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792300928 00000100:00100000:3.0:1788330050.739589:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792300928 00000100:00100000:1.0:1788330050.739734:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788330050.739749:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9987:x1875199792300928:12345-0@lo:5: 00002000:00080000:1.0:1788330050.739792:0:8632:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:1.0:1788330050.741557:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9987:x1875199792300928:12345-0@lo:5: Request processed in 1810us (2087us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788330050.741570:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:02000040:2.0:1788330050.742480:0:9991:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00010000:00080000:0.0:1788330050.743002:0:9987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc70f9c00 x1875199792300928/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788330066 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330050.743023:0:9987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9987:1875199792300928:0@lo:5: 00000004:00080000:0.0:1788330050.743039:0:9987:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788330050.743095:0:9987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9987:1875199792301056:0@lo:900: 00000100:00100000:0.0:1788330050.743192:0:9987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330050.743222:0:9987:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec532e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330050.743840:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792301056 00000100:00100000:1.0:1788330050.743848:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792301056 00000100:00100000:1.0:1788330050.743953:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788330050.743964:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9987:x1875199792301056:12345-0@lo:900: 00000100:00100000:1.0:1788330050.744036:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9987:x1875199792301056:12345-0@lo:900: Request processed in 75us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330050.744042:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788330050.744103:0:9987:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fed80 x1875199792301056/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788330066 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330050.744112:0:9987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9987:1875199792301056:0@lo:900: 00000100:00100000:0.0:1788330050.749353:0:9991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9991:1875199792301184:0@lo:5: 00000100:00100000:0.0:1788330050.749549:0:9991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330050.749597:0:9991:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec532e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330050.749780:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792301184 00000100:00100000:2.0:1788330050.749788:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792301184 00000100:00100000:2.0:1788330050.749860:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788330050.749872:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9991:x1875199792301184:12345-0@lo:5: 00002000:00080000:3.0:1788330050.759326:0:8439:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788330050.759347:0:8439:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1788330050.764528:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9991:x1875199792301184:12345-0@lo:5: Request processed in 14650us (14972us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788330050.764541:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788330050.764705:0:9991:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fed80 x1875199792301184/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788330066 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330050.764729:0:9991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9991:1875199792301184:0@lo:5: 00000004:00080000:0.0:1788330050.764749:0:9991:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:00080000:3.0:1788330050.827612:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:3.0:1788330050.827638:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1788330050.971546:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792301312:0@lo:41: 00000100:00100000:1.0:1788330050.971647:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330050.972600:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792301312 00000100:00100000:0.0:1788330050.972642:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792301312 00000100:00100000:0.0:1788330050.972709:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788330050.972720:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792301312:12345-0@lo:41: 00000004:00000024:0.0:1788330050.972761:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788330050.972826:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792301312:12345-0@lo:41: Request processed in 108us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330050.972835:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788330050.974061:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792301312:0@lo:41: 00010000:00010000:2.0:1788330051.484118:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788330051.881066:0:10042:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788330051.881768:0:10042:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788330052.507379:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330052.508240:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788330052.508270:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792301440:0@lo:13: 00000100:00100000:0.0:1788330052.508350:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330052.508436:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792301440 00000100:00100000:0.0:1788330052.508446:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792301440 00000100:00100000:0.0:1788330052.508506:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788330052.508517:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792301440:12345-0@lo:13: 00002000:00000024:0.0:1788330052.508866:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330052.509872:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792301440:12345-0@lo:13: Request processed in 1352us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330052.510701:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788330052.510820:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330052.510996:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330052.511017:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792301568:0@lo:13: 00000100:00100000:1.0:1788330052.511076:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788330052.511175:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fdf80 x1875199792301440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330052.511200:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792301440:0@lo:13: 00000100:00100000:3.0:1788330052.512220:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792301568 00000100:00100000:3.0:1788330052.512232:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792301568 00000100:00100000:3.0:1788330052.512315:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788330052.512325:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792301568:12345-0@lo:13: 00002000:00000024:3.0:1788330052.512348:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330052.512406:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792301568:12345-0@lo:13: Request processed in 82us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330052.512413:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788330052.512501:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc5ee8a80 x1875199792301568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330052.512518:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792301568:0@lo:13: 00000100:00080000:0.0:1788330052.512684:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:1.0:1788330052.985877:0:10090:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788330052.985896:0:10090:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1788330053.531421:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330053.531449:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792301696:0@lo:41: 00000100:00100000:1.0:1788330053.531551:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330053.531948:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792301696 00000100:00100000:2.0:1788330053.531958:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792301696 00000100:00100000:2.0:1788330053.537355:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788330053.537386:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792301696:12345-0@lo:41: 00000004:00000024:2.0:1788330053.537434:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788330053.537529:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792301696:12345-0@lo:41: Request processed in 161us (5976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330053.537537:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:2.0:1788330053.537632:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330053.549600:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792301696:0@lo:41: 00010000:00010000:1.0:1788330054.558083:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330054.692759:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330054.696804:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766036864 00000100:00100000:2.0:1788330054.696871:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766036864 00000100:00100000:3.0:1788330054.696998:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 181 00000100:00100000:3.0:1788330054.697009:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2409:x1875199766036864:12345-192.168.202.50@tcp:250: 00010000:00080000:3.0:1788330054.697046:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from aa3490c8-da14-415b-81e3-af4ba0c476db@192.168.202.50@tcp t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:3.0:1788330054.697094:0:6517:0:(genops.c:1385:class_connect()) connect: client aa3490c8-da14-415b-81e3-af4ba0c476db, cookie 0x8475908e9fd0e7a 00000100:00080000:3.0:1788330054.697447:0:6517:0:(import.c:65:import_set_state_nolock()) ffff99edc7702800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788330054.697524:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+5:2409:x1875199766036864:12345-192.168.202.50@tcp:250: Request processed in 515us (4990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330054.697537:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 181 00000100:00100000:1.0:1788330054.700355:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330054.700404:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766036736 00000100:00100000:0.0:1788330054.700413:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766036736 00000100:00100000:0.0:1788330054.700464:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 182 00000100:00100000:0.0:1788330054.700472:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+5:6173:x1875199766036736:12345-192.168.202.50@tcp:101: 00010000:00010000:0.0:1788330054.700489:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330054.700503:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef58c2a00/0x8475908e9fd0e81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105c9e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330054.700882:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef58c2a00/0x8475908e9fd0e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105c9e expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330054.700895:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef58c2a00/0x8475908e9fd0e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105c9e expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330054.700906:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c2a00, rc 0) 00000100:00100000:0.0:1788330054.701110:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+6:6173:x1875199766036736:12345-192.168.202.50@tcp:101: Request processed in 635us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330054.701118:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 182 00000100:00100000:0.0:1788330054.705313:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330054.705418:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766036992 00000100:00100000:3.0:1788330054.705430:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766036992 00000100:00100000:3.0:1788330054.705493:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 183 00000100:00100000:3.0:1788330054.705506:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+6:6173:x1875199766036992:12345-192.168.202.50@tcp:501: 00000100:00100000:3.0:1788330054.705647:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+6:6173:x1875199766036992:12345-192.168.202.50@tcp:501: Request processed in 143us (346us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788330054.705663:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 183 00000100:00100000:1.0:1788330054.712257:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330054.712637:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766037120 00000100:00100000:0.0:1788330054.712649:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766037120 00000100:00100000:0.0:1788330054.712734:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 184 00000100:00100000:0.0:1788330054.712746:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+6:6173:x1875199766037120:12345-192.168.202.50@tcp:101: 00010000:00010000:0.0:1788330054.712765:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330054.712783:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef58c3000/0x8475908e9fd0e88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105ca5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330054.712813:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef58c3000/0x8475908e9fd0e88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ca5 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330054.713120:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef58c3000/0x8475908e9fd0e88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ca5 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330054.713129:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c3000, rc 0) 00000100:00100000:0.0:1788330054.713238:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+7:6173:x1875199766037120:12345-192.168.202.50@tcp:101: Request processed in 493us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330054.713265:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 184 00000100:00100000:1.0:1788330054.719328:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330054.719670:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766037248 00000100:00100000:2.0:1788330054.719683:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766037248 00000100:00100000:2.0:1788330054.719760:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 185 00000100:00100000:2.0:1788330054.719769:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+7:6173:x1875199766037248:12345-192.168.202.50@tcp:501: 00000100:00100000:2.0:1788330054.719967:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+8:6173:x1875199766037248:12345-192.168.202.50@tcp:501: Request processed in 197us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330054.719994:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 185 00000100:00100000:1.0:1788330054.737804:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330054.738428:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766037376 00000100:00100000:3.0:1788330054.738441:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766037376 00000100:00100000:3.0:1788330054.738505:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 186 00000100:00100000:3.0:1788330054.738515:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+8:6173:x1875199766037376:12345-192.168.202.50@tcp:503: 00000100:00100000:3.0:1788330054.738717:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+8:6173:x1875199766037376:12345-192.168.202.50@tcp:503: Request processed in 202us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330054.738732:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 186 00000100:00100000:1.0:1788330054.744297:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330054.744475:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766037504 00000100:00100000:0.0:1788330054.744496:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766037504 00000100:00100000:0.0:1788330054.744558:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 187 00000100:00100000:0.0:1788330054.744569:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+8:6191:x1875199766037504:12345-192.168.202.50@tcp:502: 00000100:00100000:0.0:1788330054.744770:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+8:6191:x1875199766037504:12345-192.168.202.50@tcp:502: Request processed in 202us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330054.744778:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 187 00000100:00100000:1.0:1788330054.799209:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330054.799324:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766037632 00000100:00100000:2.0:1788330054.799335:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766037632 00000100:00100000:2.0:1788330054.799388:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 188 00000100:00100000:2.0:1788330054.799397:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec2d19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+8:6191:x1875199766037632:12345-192.168.202.50@tcp:502: 00000100:00100000:2.0:1788330054.799576:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec2d19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+8:6191:x1875199766037632:12345-192.168.202.50@tcp:502: Request processed in 178us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330054.799583:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 188 00000100:00100000:1.0:1788330054.807010:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330054.807193:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766037760 00000100:00100000:0.0:1788330054.807202:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766037760 00000100:00100000:0.0:1788330054.807258:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 189 00000100:00100000:0.0:1788330054.807267:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec2d19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+8:6173:x1875199766037760:12345-192.168.202.50@tcp:101: 00010000:00010000:0.0:1788330054.807286:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330054.807302:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef58c3e00/0x8475908e9fd0e8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105cd6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330054.807330:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef58c3e00/0x8475908e9fd0e8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105cd6 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330054.807340:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef58c3e00/0x8475908e9fd0e8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105cd6 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330054.807349:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c3e00, rc 0) 00000100:00100000:0.0:1788330054.807401:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec2d19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+9:6173:x1875199766037760:12345-192.168.202.50@tcp:101: Request processed in 135us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330054.807408:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 189 00000100:00100000:1.0:1788330054.814517:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330054.814811:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766037888 00000100:00100000:0.0:1788330054.814848:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766037888 00000100:00100000:0.0:1788330054.814915:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 190 00000100:00100000:0.0:1788330054.814926:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+9:6173:x1875199766037888:12345-192.168.202.50@tcp:256: 20000000:01000000:0.0:1788330054.818170:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788330054.818219:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788330054.818223:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788330054.818227:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788330054.818231:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788330054.818235:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788330054.828442:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+9:6173:x1875199766037888:12345-192.168.202.50@tcp:256: Request processed in 13501us (13923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330054.828458:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 190 00000100:00100000:1.0:1788330054.833319:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330054.833425:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766038016 00000100:00100000:2.0:1788330054.833436:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766038016 00000100:00100000:3.0:1788330054.833569:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 191 00000100:00100000:3.0:1788330054.833582:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+9:6173:x1875199766038016:12345-192.168.202.50@tcp:101: 00010000:00010000:3.0:1788330054.833602:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330054.833623:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef59cbe00/0x8475908e9fd0e96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105cdd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330054.833664:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef59cbe00/0x8475908e9fd0e96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105cdd expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330054.833677:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef59cbe00/0x8475908e9fd0e96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105cdd expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330054.833687:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cbe00, rc 0) 00000100:00100000:3.0:1788330054.833766:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6173:x1875199766038016:12345-192.168.202.50@tcp:101: Request processed in 187us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330054.833774:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 191 00000100:00100000:1.0:1788330054.840016:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330054.840203:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766038144 00000100:00100000:0.0:1788330054.840214:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766038144 00000100:00100000:0.0:1788330054.840275:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 192 00000100:00100000:0.0:1788330054.840287:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef40a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6173:x1875199766038144:12345-192.168.202.50@tcp:501: 00000100:00100000:0.0:1788330054.840454:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef40a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6173:x1875199766038144:12345-192.168.202.50@tcp:501: Request processed in 170us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330054.840462:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 192 00000100:00100000:1.0:1788330054.844049:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330054.844193:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766038272 00000100:00100000:2.0:1788330054.844207:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766038272 00000100:00100000:2.0:1788330054.844274:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 193 00000100:00100000:2.0:1788330054.844284:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6173:x1875199766038272:12345-192.168.202.50@tcp:503: 00000100:00100000:2.0:1788330054.844475:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6173:x1875199766038272:12345-192.168.202.50@tcp:503: Request processed in 192us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330054.844484:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 193 00000100:00100000:1.0:1788330054.848196:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330054.848290:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766038400 00000100:00100000:3.0:1788330054.848300:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766038400 00000100:00100000:3.0:1788330054.848363:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 194 00000100:00100000:3.0:1788330054.848374:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6196:x1875199766038400:12345-192.168.202.50@tcp:502: 00000100:00100000:3.0:1788330054.848549:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6196:x1875199766038400:12345-192.168.202.50@tcp:502: Request processed in 176us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330054.848559:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 194 00000100:00100000:1.0:1788330054.852200:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330054.852306:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766038528 00000100:00100000:0.0:1788330054.852316:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766038528 00000100:00100000:0.0:1788330054.852377:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 195 00000100:00100000:0.0:1788330054.852388:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00beb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6196:x1875199766038528:12345-192.168.202.50@tcp:502: 00000100:00100000:0.0:1788330054.852553:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00beb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6196:x1875199766038528:12345-192.168.202.50@tcp:502: Request processed in 165us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330054.852562:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 195 00000100:00100000:1.0:1788330054.860322:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330054.861281:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330054.861383:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766038656 00000100:00100000:2.0:1788330054.861394:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766038656 00000100:00100000:2.0:1788330054.861443:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766038912 00000100:00100000:2.0:1788330054.861448:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766038912 00000100:00100000:2.0:1788330054.861479:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:2.0:1788330054.861496:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2409:x1875199766038656:12345-192.168.202.50@tcp:38: 00010000:00080000:2.0:1788330054.861531:0:7832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:2.0:1788330054.861587:0:7832:0:(genops.c:1385:class_connect()) connect: client f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3, cookie 0x8475908e9fd0e9d 00000004:00100000:2.0:1788330054.861614:0:7832:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788330054.862209:0:7832:0:(import.c:65:import_set_state_nolock()) ffff99edc5c6a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330054.862282:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2409:x1875199766038656:12345-192.168.202.50@tcp:38: Request processed in 793us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330054.862291:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:2.0:1788330054.862316:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:2.0:1788330054.862321:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2409:x1875199766038912:12345-192.168.202.50@tcp:38: 00010000:00080000:2.0:1788330054.862339:0:7832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:2.0:1788330054.862388:0:7832:0:(genops.c:1385:class_connect()) connect: client f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3, cookie 0x8475908e9fd0ea4 00000004:00100000:2.0:1788330054.862403:0:7832:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788330054.862608:0:7832:0:(import.c:65:import_set_state_nolock()) ffff99eeffce8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330054.866066:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2409:x1875199766038912:12345-192.168.202.50@tcp:38: Request processed in 312us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330054.866084:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 8 00010000:00010000:2.0:1788330055.590079:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330055.869919:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330055.870526:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766039040 00000100:00100000:3.0:1788330055.870542:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766039040 00000100:00100000:3.0:1788330055.870751:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:3.0:1788330055.870762:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:0:x1875199766039040:12345-192.168.202.50@tcp:41: 00000004:00000024:3.0:1788330055.870802:0:6524:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788330055.870880:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:0:x1875199766039040:12345-192.168.202.50@tcp:41: Request processed in 119us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330055.870888:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00080000:0.0:1788330055.871214:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788330055.872603:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330055.872630:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330055.872684:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766039168 00000100:00100000:2.0:1788330055.872693:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766039168 00000100:00080000:3.0:1788330055.872803:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330055.872804:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766038784 00000100:00100000:2.0:1788330055.872808:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766038784 00000100:00100000:0.0:1788330055.872880:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:1.0:1788330055.872886:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:0.0:1788330055.872891:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:6173:x1875199766039168:12345-192.168.202.50@tcp:41: 00000100:00100000:1.0:1788330055.872893:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:0:x1875199766038784:12345-192.168.202.50@tcp:41: 00000004:00000024:1.0:1788330055.872923:0:6524:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000004:00000024:0.0:1788330055.872923:0:6523:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788330055.873000:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:0:x1875199766038784:12345-192.168.202.50@tcp:41: Request processed in 106us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330055.873007:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:0.0:1788330055.874141:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:6173:x1875199766039168:12345-192.168.202.50@tcp:41: Request processed in 1246us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330055.874254:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:2.0:1788330055.878952:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330055.879097:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766039296 00000100:00100000:1.0:1788330055.879107:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766039296 00000100:00100000:1.0:1788330055.879243:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:1.0:1788330055.879255:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:6173:x1875199766039296:12345-192.168.202.50@tcp:40: 00000100:00100000:1.0:1788330055.879363:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:6173:x1875199766039296:12345-192.168.202.50@tcp:40: Request processed in 109us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330055.879372:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:3.0:1788330055.885606:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330055.885664:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330055.885711:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330055.885775:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330055.885776:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766039424 00000100:00100000:0.0:1788330055.885786:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766039424 00000100:00100000:0.0:1788330055.885821:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766039552 00000100:00100000:0.0:1788330055.885824:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766039552 00000100:00100000:0.0:1788330055.885848:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:0.0:1788330055.885856:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2409:x1875199766039424:12345-192.168.202.50@tcp:8: 00010000:00080000:0.0:1788330055.885892:0:8437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp t0 exp 0000000000000000 cur 259 last 0 00000100:00100000:3.0:1788330055.885934:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:3.0:1788330055.885941:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2409:x1875199766039552:12345-192.168.202.50@tcp:8: 00000020:00000080:0.0:1788330055.885943:0:8437:0:(genops.c:1385:class_connect()) connect: client f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3, cookie 0x8475908e9fd0eab 00002000:00100000:0.0:1788330055.885955:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3/ffff99edc75d2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00010000:00080000:3.0:1788330055.885957:0:8440:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:3.0:1788330055.885973:0:8440:0:(genops.c:1385:class_connect()) connect: client f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3, cookie 0x8475908e9fd0eb2 00002000:00100000:0.0:1788330055.885973:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:3.0:1788330055.885977:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3/ffff99edc7706800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788330055.885988:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788330055.886291:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788330055.886330:0:8440:0:(import.c:65:import_set_state_nolock()) ffff99edc7701800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330055.886718:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766039680 00000100:00100000:2.0:1788330055.886725:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766039680 00000100:00100000:2.0:1788330055.886775:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:2.0:1788330055.886783:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:6173:x1875199766039680:12345-192.168.202.50@tcp:900: 00000100:00100000:3.0:1788330055.886877:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2409:x1875199766039552:12345-192.168.202.50@tcp:8: Request processed in 934us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330055.886885:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:3.0:1788330055.886931:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766039808 00000100:00100000:3.0:1788330055.886935:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766039808 00000100:00100000:3.0:1788330055.886965:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 196 00000100:00100000:3.0:1788330055.886971:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00bea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2411:x1875199766039808:12345-192.168.202.50@tcp:400: 00000100:00100000:2.0:1788330055.889031:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:6173:x1875199766039680:12345-192.168.202.50@tcp:900: Request processed in 2233us (3303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330055.889048:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:3.0:1788330055.889269:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00bea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2411:x1875199766039808:12345-192.168.202.50@tcp:400: Request processed in 2294us (3490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330055.889279:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 196 00002000:00080000:0.0:1788330055.889869:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788330055.889911:0:8437:0:(import.c:65:import_set_state_nolock()) ffff99edc75d1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330055.889961:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2409:x1875199766039424:12345-192.168.202.50@tcp:8: Request processed in 4105us (4369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330055.889969:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:3.0:1788330055.896367:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330055.896582:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766039936 00000100:00100000:2.0:1788330055.896610:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766039936 00000100:00100000:2.0:1788330055.896721:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:2.0:1788330055.896733:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:6173:x1875199766039936:12345-192.168.202.50@tcp:33: 00000004:00080000:2.0:1788330055.936136:0:6525:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 39306us 00000004:00200000:3.0:1788330056.003052:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788330056.003225:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:6173:x1875199766039936:12345-192.168.202.50@tcp:33: Request processed in 106488us (106863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330056.003243:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:2.0:1788330056.093178:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792301824:0@lo:400: 00000100:00100000:2.0:1788330056.093365:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330056.093412:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792302336:0@lo:400: 00000100:00100000:2.0:1788330056.093435:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330056.093451:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792302848:0@lo:400: 00000100:00100000:2.0:1788330056.093468:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330056.093482:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792303360:0@lo:400: 00000100:00100000:2.0:1788330056.093497:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330056.093515:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788330056.093520:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792302208:0@lo:400: 00000100:00100000:2.0:1788330056.093538:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330056.093551:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792302720:0@lo:400: 00000100:00100000:2.0:1788330056.093565:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330056.093576:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792303232:0@lo:400: 00000100:00100000:2.0:1788330056.093589:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330056.093604:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792303744:0@lo:13: 00000100:00100000:2.0:1788330056.093619:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330056.093659:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792301824 00000100:00100000:2.0:1788330056.093666:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792301824 00000100:00100000:2.0:1788330056.093716:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788330056.093723:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00bea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3649:x1875199792301824:12345-0@lo:400: 00000100:00100000:2.0:1788330056.093786:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00bea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3649:x1875199792301824:12345-0@lo:400: Request processed in 63us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330056.093794:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788330056.093828:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792302336 00000100:00100000:2.0:1788330056.093832:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792302336 00000100:00100000:2.0:1788330056.093858:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788330056.093864:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792302336:12345-0@lo:400: 00000100:00100000:2.0:1788330056.093895:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792302336:12345-0@lo:400: Request processed in 32us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330056.093901:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788330056.093918:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792302848 00000100:00100000:2.0:1788330056.093922:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792302848 00000100:00100000:2.0:1788330056.093949:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792303360 00000100:00100000:2.0:1788330056.093952:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792303360 00000100:00100000:2.0:1788330056.093965:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792302720 00000100:00100000:2.0:1788330056.093967:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792302720 00000100:00100000:2.0:1788330056.093979:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792303232 00000100:00100000:2.0:1788330056.093980:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792303232 00000100:00100000:2.0:1788330056.093989:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788330056.093993:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792302848:12345-0@lo:400: 00000100:00100000:2.0:1788330056.094015:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792302848:12345-0@lo:400: Request processed in 22us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330056.094018:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788330056.094024:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788330056.094027:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792303360:12345-0@lo:400: 00000100:00100000:2.0:1788330056.094058:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792303360:12345-0@lo:400: Request processed in 30us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330056.094062:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788330056.094074:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788330056.094077:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792302720:12345-0@lo:400: 00000100:00100000:2.0:1788330056.094093:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792302720:12345-0@lo:400: Request processed in 16us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330056.094097:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788330056.094102:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788330056.094105:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792303232:12345-0@lo:400: 00000100:00100000:2.0:1788330056.094116:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792303232:12345-0@lo:400: Request processed in 11us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330056.094119:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788330056.094133:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792302208 00000100:00100000:2.0:1788330056.094135:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792302208 00000100:00100000:2.0:1788330056.094169:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788330056.094175:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792302208:12345-0@lo:400: 00000100:00100000:2.0:1788330056.094198:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792302208:12345-0@lo:400: Request processed in 24us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330056.094201:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788330056.094217:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792303744 00000100:00100000:2.0:1788330056.094219:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792303744 00000100:00100000:2.0:1788330056.094234:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788330056.094238:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792303744:12345-0@lo:13: 00002000:00000024:2.0:1788330056.094248:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330056.094268:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792303744:12345-0@lo:13: Request processed in 30us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330056.094271:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788330056.094283:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330056.094286:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788330056.094314:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc76dce00 x1875199792302208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330056.094325:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792302208:0@lo:400: 00010000:00080000:2.0:1788330056.094331:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6da1f80 x1875199792302720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330056.094336:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792302720:0@lo:400: 00010000:00080000:2.0:1788330056.094341:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6da3100 x1875199792303232/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330056.094346:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788330056.094357:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792303232:0@lo:400: 00010000:00080000:2.0:1788330056.094362:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eee7640a80 x1875199792303744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330056.094371:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792303744:0@lo:13: 00000100:00100000:2.0:1788330056.094376:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792301824:0@lo:400: 00000100:00100000:2.0:1788330056.094380:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792302336:0@lo:400: 00010000:00080000:2.0:1788330056.094385:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6da1880 x1875199792302848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330056.094390:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792302848:0@lo:400: 00010000:00080000:2.0:1788330056.094399:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6da0000 x1875199792303360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330056.094403:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788330056.094407:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792303360:0@lo:400: 00000100:00100000:3.0:1788330056.095108:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792301952:0@lo:400: 00000100:00100000:3.0:1788330056.095145:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330056.095184:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792302464:0@lo:400: 00000100:00100000:3.0:1788330056.095211:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330056.095228:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792302976:0@lo:400: 00000100:00100000:3.0:1788330056.095247:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330056.095260:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792303488:0@lo:13: 00000100:00100000:3.0:1788330056.095280:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330056.095296:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788330056.095302:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792302080:0@lo:400: 00000100:00100000:3.0:1788330056.095323:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330056.095339:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792302592:0@lo:400: 00000100:00100000:3.0:1788330056.095359:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330056.095370:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792303104:0@lo:400: 00000100:00100000:3.0:1788330056.095408:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330056.095419:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792303616:0@lo:41: 00000100:00100000:3.0:1788330056.095450:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330056.095493:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792301952 00000100:00100000:3.0:1788330056.095498:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792301952 00000100:00100000:3.0:1788330056.095519:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792302464 00000100:00100000:3.0:1788330056.095522:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792302464 00000100:00100000:3.0:1788330056.095669:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792302976 00000100:00100000:3.0:1788330056.095673:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792302976 00000100:00100000:3.0:1788330056.095850:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792302592 00000100:00100000:3.0:1788330056.095854:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792302592 00000100:00100000:3.0:1788330056.095872:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792303104 00000100:00100000:3.0:1788330056.095874:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792303104 00000100:00100000:3.0:1788330056.095890:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788330056.095897:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792301952:12345-0@lo:400: 00000100:00100000:3.0:1788330056.095942:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792301952:12345-0@lo:400: Request processed in 46us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330056.095948:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788330056.095964:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788330056.095970:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792302464:12345-0@lo:400: 00000100:00100000:3.0:1788330056.095996:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792302464:12345-0@lo:400: Request processed in 27us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330056.096002:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788330056.096013:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788330056.096019:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792302976:12345-0@lo:400: 00000100:00100000:3.0:1788330056.096045:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792302976:12345-0@lo:400: Request processed in 26us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330056.096050:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788330056.096061:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788330056.096066:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792302592:12345-0@lo:400: 00000100:00100000:3.0:1788330056.096102:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792302592:12345-0@lo:400: Request processed in 36us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330056.096107:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788330056.096120:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788330056.096126:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792303104:12345-0@lo:400: 00000100:00100000:3.0:1788330056.096148:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792303104:12345-0@lo:400: Request processed in 23us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330056.096417:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788330056.096459:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6ea3100 x1875199792302592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330056.096470:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792302592:0@lo:400: 00010000:00080000:3.0:1788330056.096479:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6da0e00 x1875199792303104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330056.096487:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792303104:0@lo:400: 00010000:00080000:3.0:1788330056.096496:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc76ddc00 x1875199792301952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330056.096502:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792301952:0@lo:400: 00010000:00080000:3.0:1788330056.096510:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc76dd500 x1875199792302464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330056.096517:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792302464:0@lo:400: 00010000:00080000:3.0:1788330056.096526:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6da3480 x1875199792302976/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330056.096533:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792302976:0@lo:400: 00000100:00100000:0.0:1788330056.097051:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792302080 00000100:00100000:0.0:1788330056.097058:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792302080 00000100:00100000:0.0:1788330056.097085:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792303616 00000100:00100000:0.0:1788330056.097088:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792303616 00000100:00100000:0.0:1788330056.097102:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788330056.097110:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792302080:12345-0@lo:400: 00000100:00100000:0.0:1788330056.097197:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792302080:12345-0@lo:400: Request processed in 88us (1873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330056.097204:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788330056.097219:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788330056.097225:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792303616:12345-0@lo:41: 00000004:00000024:0.0:1788330056.097249:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788330056.097281:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792303616:12345-0@lo:41: Request processed in 56us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330056.097287:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788330056.097482:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792302080:0@lo:400: 00000100:00100000:3.0:1788330056.097499:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792303616:0@lo:41: 00000100:00080000:2.0:1788330056.097881:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788330056.097888:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330056.097902:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792303488 00000100:00100000:2.0:1788330056.097906:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792303488 00000100:00100000:2.0:1788330056.097985:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788330056.097994:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792303488:12345-0@lo:13: 00002000:00000024:2.0:1788330056.098008:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330056.098057:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792303488:12345-0@lo:13: Request processed in 65us (2776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330056.098063:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788330056.098122:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc70fbb80 x1875199792303488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330056.098135:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792303488:0@lo:13: 00000100:00100000:1.0:1788330056.201881:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330056.201983:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766040064 00000100:00100000:3.0:1788330056.201994:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766040064 00000100:00100000:3.0:1788330056.202064:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:3.0:1788330056.202076:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:6214:x1875199766040064:12345-192.168.202.50@tcp:101: 00010000:00010000:3.0:1788330056.202099:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330056.202127:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cac00/0x8475908e9fd0eb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105d0e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330056.202226:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd0ec0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330056.202239:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd0ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330056.202254:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd0ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330056.202302:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788330056.202305:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788330056.202322:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd0ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330056.202349:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cac00/0x8475908e9fd0eb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d0e expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330056.202388:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd0ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d0e expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330056.202397:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecda4d500) 00010000:00010000:3.0:1788330056.202400:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330056.202404:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cb600, rc 0) 00000100:00100000:3.0:1788330056.202469:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:6214:x1875199766040064:12345-192.168.202.50@tcp:101: Request processed in 395us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330056.202476:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 13 00010000:00010000:1.0:1788330056.605753:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330057.627671:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788330057.627700:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792304000:0@lo:13: 00000100:00100000:3.0:1788330057.627773:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330057.627858:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792304000 00000100:00100000:3.0:1788330057.627866:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792304000 00000100:00100000:3.0:1788330057.627913:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788330057.627922:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792304000:12345-0@lo:13: 00002000:00000024:3.0:1788330057.627950:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330057.628083:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330057.628094:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792303872:0@lo:13: 00000100:00100000:0.0:1788330057.628198:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330057.628531:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792304000:12345-0@lo:13: Request processed in 609us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330057.628539:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788330057.628555:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792303872 00000100:00100000:3.0:1788330057.628559:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792303872 00000100:00100000:3.0:1788330057.628574:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788330057.628580:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792303872:12345-0@lo:13: 00002000:00000024:3.0:1788330057.628591:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00010000:2.0:1788330057.628592:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330057.628624:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792303872:12345-0@lo:13: Request processed in 44us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330057.628650:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788330057.628667:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eee7640a80 x1875199792303872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330057.628686:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792303872:0@lo:13: 00010000:00080000:0.0:1788330057.628768:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eed82d0380 x1875199792304000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330057.628779:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792304000:0@lo:13: 00000100:00100000:3.0:1788330058.327020:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330058.327193:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766040192 00000100:00100000:2.0:1788330058.327203:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766040192 00000100:00100000:2.0:1788330058.327286:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:2.0:1788330058.327297:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:6267:x1875199766040192:12345-192.168.202.50@tcp:41: 00000004:00000024:2.0:1788330058.327340:0:6522:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788330058.327414:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:6267:x1875199766040192:12345-192.168.202.50@tcp:41: Request processed in 118us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330058.327422:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00080000:0.0:1788330058.327867:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330058.333944:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330058.334058:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766040320 00000100:00100000:3.0:1788330058.334072:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766040320 00000100:00100000:3.0:1788330058.334215:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:3.0:1788330058.334229:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:6267:x1875199766040320:12345-192.168.202.50@tcp:41: 00000004:00000024:3.0:1788330058.334284:0:6524:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788330058.334375:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:6267:x1875199766040320:12345-192.168.202.50@tcp:41: Request processed in 149us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330058.334383:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00080000:0.0:1788330058.334488:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788330058.337865:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330058.338289:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766040448 00000100:00100000:2.0:1788330058.338305:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766040448 00000100:00100000:2.0:1788330058.338407:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:2.0:1788330058.338423:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:6267:x1875199766040448:12345-192.168.202.50@tcp:13: 00002000:00000024:2.0:1788330058.338472:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788330058.338485:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330058.338555:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:6267:x1875199766040448:12345-192.168.202.50@tcp:13: Request processed in 137us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330058.338565:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:2.0:1788330058.343562:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330058.344590:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766040576 00000100:00100000:3.0:1788330058.344608:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766040576 00000100:00100000:3.0:1788330058.344770:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:3.0:1788330058.344794:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:6267:x1875199766040576:12345-192.168.202.50@tcp:13: 00002000:00000024:3.0:1788330058.344840:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330058.344943:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:6267:x1875199766040576:12345-192.168.202.50@tcp:13: Request processed in 161us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330058.344952:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00080000:0.0:1788330058.346831:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788330058.652978:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330058.654696:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330058.654732:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792304128:0@lo:41: 00000100:00100000:1.0:1788330058.654831:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330058.655123:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792304128 00000100:00100000:0.0:1788330058.655134:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792304128 00000100:00100000:0.0:1788330058.655233:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788330058.655244:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792304128:12345-0@lo:41: 00000004:00000024:0.0:1788330058.655282:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788330058.655357:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792304128:12345-0@lo:41: Request processed in 113us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330058.655365:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788330058.655484:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792304128:0@lo:41: 00000001:00100000:3.0:1788330059.171991:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00010000:00010000:2.0:1788330059.677999:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330060.699449:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330061.028364:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330061.028406:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330061.028439:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330061.028468:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330061.028510:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330061.028542:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766041216 00000100:00100000:3.0:1788330061.028553:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766041216 00000100:00100000:3.0:1788330061.028651:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766041088 00000100:00100000:3.0:1788330061.028655:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766041088 00000100:00100000:3.0:1788330061.028680:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:3.0:1788330061.028690:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766041216:12345-192.168.202.50@tcp:400: 00000100:00100000:3.0:1788330061.028999:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766041216:12345-192.168.202.50@tcp:400: Request processed in 79us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330061.029008:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:3.0:1788330061.029028:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:3.0:1788330061.029036:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766041088:12345-192.168.202.50@tcp:400: 00000100:00100000:3.0:1788330061.029063:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766041088:12345-192.168.202.50@tcp:400: Request processed in 29us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330061.029069:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:3.0:1788330061.029093:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766040960 00000100:00100000:3.0:1788330061.029097:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766040960 00000100:00100000:3.0:1788330061.029129:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766040832 00000100:00100000:3.0:1788330061.029133:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766040832 00000100:00100000:3.0:1788330061.029180:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:3.0:1788330061.029187:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766040960:12345-192.168.202.50@tcp:400: 00000100:00100000:3.0:1788330061.029216:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766040960:12345-192.168.202.50@tcp:400: Request processed in 30us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330061.029389:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:0.0:1788330061.029400:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2410:x1875199766040832:12345-192.168.202.50@tcp:400: 00000100:00100000:0.0:1788330061.029432:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2410:x1875199766040832:12345-192.168.202.50@tcp:400: Request processed in 36us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330061.029438:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00080000:0.0:1788330061.029458:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330061.029463:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788330061.029466:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788330061.029468:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330061.029558:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:2.0:1788330061.029905:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766040704 00000100:00100000:2.0:1788330061.029911:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766040704 00000100:00100000:2.0:1788330061.029957:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 198 00000100:00100000:2.0:1788330061.029966:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2410:x1875199766040704:12345-192.168.202.50@tcp:400: 00000100:00100000:2.0:1788330061.029998:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2410:x1875199766040704:12345-192.168.202.50@tcp:400: Request processed in 34us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330061.030005:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 198 00000001:02000400:3.0:1788330061.118746:0:10188:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788330061.214361:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792304256:0@lo:13: 00000100:00100000:3.0:1788330061.214439:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330061.214500:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330061.214505:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792304384:0@lo:41: 00000100:00100000:3.0:1788330061.214538:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330061.214571:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792304256 00000100:00100000:3.0:1788330061.214578:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792304256 00000100:00100000:3.0:1788330061.214650:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788330061.214715:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792304256:12345-0@lo:13: 00002000:00000024:3.0:1788330061.214747:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330061.214791:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792304256:12345-0@lo:13: Request processed in 134us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330061.214798:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788330061.214827:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792304384 00000100:00100000:3.0:1788330061.214830:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792304384 00000100:00100000:3.0:1788330061.214857:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788330061.214864:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792304384:12345-0@lo:41: 00000004:00000024:3.0:1788330061.214892:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788330061.214924:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792304384:12345-0@lo:41: Request processed in 61us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330061.214930:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1788330061.214947:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330061.214995:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792304384:0@lo:41: 00010000:00080000:3.0:1788330061.215008:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc779ad80 x1875199792304256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330061.215021:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792304256:0@lo:13: 00000100:00100000:3.0:1788330061.223712:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792304640:0@lo:400: 00000100:00100000:3.0:1788330061.223819:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330061.223879:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792305152:0@lo:400: 00000100:00100000:3.0:1788330061.223899:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330061.223931:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792305664:0@lo:400: 00000100:00100000:3.0:1788330061.223953:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330061.223980:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788330061.223986:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792304512:0@lo:400: 00000100:00100000:3.0:1788330061.224014:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330061.224033:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792305024:0@lo:400: 00000100:00100000:3.0:1788330061.224057:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330061.224073:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792305536:0@lo:400: 00000100:00100000:3.0:1788330061.224093:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330061.224118:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792304640 00000100:00100000:3.0:1788330061.224126:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792304640 00000100:00100000:3.0:1788330061.224208:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792305152 00000100:00100000:3.0:1788330061.224212:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792305152 00000100:00100000:3.0:1788330061.224237:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792305664 00000100:00100000:3.0:1788330061.224239:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792305664 00000100:00100000:3.0:1788330061.224250:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792305024 00000100:00100000:3.0:1788330061.224252:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792305024 00000100:00100000:3.0:1788330061.224261:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792305536 00000100:00100000:3.0:1788330061.224263:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792305536 00000100:00100000:3.0:1788330061.224280:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788330061.224288:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792304640:12345-0@lo:400: 00000100:00100000:3.0:1788330061.224342:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792304640:12345-0@lo:400: Request processed in 54us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330061.224349:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788330061.224369:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788330061.224376:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792305152:12345-0@lo:400: 00000100:00100000:3.0:1788330061.224402:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792305152:12345-0@lo:400: Request processed in 28us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330061.224419:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788330061.224433:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788330061.224439:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792305664:12345-0@lo:400: 00000001:00100000:1.0:1788330061.226421:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00000100:00100000:0.0:1788330061.228745:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788330061.228773:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792305024:12345-0@lo:400: 00000100:00100000:0.0:1788330061.228892:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792305024:12345-0@lo:400: Request processed in 131us (4833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330061.228900:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788330061.228930:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788330061.228937:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792305536:12345-0@lo:400: 00000100:00100000:0.0:1788330061.228969:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792305536:12345-0@lo:400: Request processed in 33us (4875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330061.228975:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788330061.229178:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792304896:0@lo:400: 00000100:00100000:0.0:1788330061.229218:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330061.229243:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792305408:0@lo:400: 00000100:00100000:0.0:1788330061.229269:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330061.229291:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792305920:0@lo:13: 00000100:00100000:0.0:1788330061.229313:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330061.229352:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788330061.229360:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792304768:0@lo:400: 00000100:00100000:0.0:1788330061.229388:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330061.229411:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792305280:0@lo:400: 00000100:00100000:0.0:1788330061.229435:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330061.229454:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792305792:0@lo:400: 00000100:00100000:0.0:1788330061.229473:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330061.229500:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792304896 00000100:00100000:0.0:1788330061.229508:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792304896 00000100:00100000:0.0:1788330061.229542:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788330061.229549:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792304896:12345-0@lo:400: 00000100:00100000:0.0:1788330061.229584:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792304896:12345-0@lo:400: Request processed in 36us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330061.229590:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788330061.229623:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792305408 00000100:00100000:0.0:1788330061.229627:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792305408 00000100:00100000:0.0:1788330061.229654:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792305280 00000100:00100000:0.0:1788330061.229657:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792305280 00000100:00100000:0.0:1788330061.229669:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792305792 00000100:00100000:0.0:1788330061.229672:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792305792 00000100:00100000:0.0:1788330061.229686:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788330061.229691:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792305408:12345-0@lo:400: 00000100:00100000:0.0:1788330061.229724:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792305408:12345-0@lo:400: Request processed in 32us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330061.229731:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788330061.229745:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788330061.229751:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792305280:12345-0@lo:400: 00000100:00100000:0.0:1788330061.229776:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792305280:12345-0@lo:400: Request processed in 25us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330061.229790:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788330061.229803:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788330061.229809:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792305792:12345-0@lo:400: 00000100:00100000:0.0:1788330061.229839:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792305792:12345-0@lo:400: Request processed in 30us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330061.229845:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788330061.229864:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792304768 00000100:00100000:0.0:1788330061.229868:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792304768 00000100:00100000:0.0:1788330061.229892:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788330061.229900:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792304768:12345-0@lo:400: 00000100:00100000:0.0:1788330061.229929:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792304768:12345-0@lo:400: Request processed in 31us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330061.229936:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788330061.229987:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792304768:0@lo:400: 00010000:00080000:0.0:1788330061.230004:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7798380 x1875199792305280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330061.230015:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792305280:0@lo:400: 00010000:00080000:0.0:1788330061.230025:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7798e00 x1875199792305792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330061.230033:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792305792:0@lo:400: 00000100:00100000:0.0:1788330061.230044:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792304896:0@lo:400: 00010000:00080000:0.0:1788330061.230053:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7799f80 x1875199792305408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330061.230061:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792305408:0@lo:400: 00000100:00100000:0.0:1788330061.230106:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792305920 00000100:00100000:0.0:1788330061.230110:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792305920 00000100:00100000:0.0:1788330061.230135:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788330061.230143:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792305920:12345-0@lo:13: 00002000:00000024:0.0:1788330061.230184:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330061.230225:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792305920:12345-0@lo:13: Request processed in 83us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330061.230231:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788330061.230258:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc9dc00 x1875199792305920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330061.230272:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792305920:0@lo:13: 00000100:00080000:3.0:1788330061.234098:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330061.234106:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330061.234111:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788330061.234114:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788330061.234267:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792305024:0@lo:400: 00000100:00100000:3.0:1788330061.234283:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792305536:0@lo:400: 00000100:00100000:3.0:1788330061.234296:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792304640:0@lo:400: 00010000:00080000:3.0:1788330061.234310:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7799500 x1875199792305152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330061.234320:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792305152:0@lo:400: 00000100:00100000:3.0:1788330061.234544:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792305664:12345-0@lo:400: Request processed in 10104us (10589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330061.234556:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788330061.234727:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792304512 00000100:00100000:2.0:1788330061.234737:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792304512 00000100:00100000:2.0:1788330061.234783:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788330061.234792:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792304512:12345-0@lo:400: 00000100:00100000:2.0:1788330061.234830:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792304512:12345-0@lo:400: Request processed in 39us (10815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330061.234836:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788330061.235063:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792304512:0@lo:400: 00010000:00080000:0.0:1788330061.235077:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc779b480 x1875199792305664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330061.235087:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792305664:0@lo:400: 00000001:00100000:3.0:1788330061.235345:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00010000:00010000:2.0:1788330061.724512:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788330062.239394:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00010000:00010000:1.0:1788330062.751243:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330062.751693:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792306048:0@lo:13: 00000100:00100000:1.0:1788330062.751777:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330062.753909:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792306176:0@lo:13: 00000100:00100000:3.0:1788330062.754413:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330062.754561:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792306048 00000100:00100000:1.0:1788330062.754570:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792306048 00000100:00100000:1.0:1788330062.754687:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792306176 00000100:00100000:1.0:1788330062.754691:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792306176 00000100:00100000:1.0:1788330062.754723:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788330062.754731:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792306048:12345-0@lo:13: 00002000:00000024:1.0:1788330062.754763:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330062.754830:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792306048:12345-0@lo:13: Request processed in 100us (3053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330062.754837:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788330062.754855:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788330062.754862:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792306176:12345-0@lo:13: 00002000:00000024:1.0:1788330062.754872:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330062.754897:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792306176:12345-0@lo:13: Request processed in 37us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330062.754903:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788330062.755099:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc9dc00 x1875199792306176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330062.755122:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792306176:0@lo:13: 00010000:00080000:3.0:1788330062.755187:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7799500 x1875199792306048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330062.755207:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792306048:0@lo:13: 00000100:00100000:3.0:1788330063.772579:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792306304:0@lo:41: 00010000:00010000:2.0:1788330063.773734:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330063.776989:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330063.778774:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792306304 00000100:00100000:0.0:1788330063.778795:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792306304 00000100:00100000:0.0:1788330063.778877:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788330063.778889:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792306304:12345-0@lo:41: 00000004:00000024:0.0:1788330063.778938:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788330063.779054:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792306304:12345-0@lo:41: Request processed in 167us (2073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330063.779062:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788330063.786338:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792306304:0@lo:41: 00010000:00010000:1.0:1788330064.797341:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788330064.923073:0:10335:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeba31caf0 20000000:00000080:3.0:1788330064.923095:0:10335:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99edc779fc00 uarg=0000000000000000 20000000:01000000:3.0:1788330064.923369:0:10335:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788330064.923373:0:10335:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788330064.923376:0:10335:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788330064.923382:0:10335:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788330064.923390:0:10335:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788330064.923469:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788330064.923473:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788330064.924145:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1788330064.924348:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1788330064.924384:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1788330064.924394:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1788330064.924404:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788330064.924406:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788330064.924962:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1788330064.925280:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1788330064.925312:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1788330064.925328:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1788330064.925339:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788330064.925341:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788330064.926481:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1788330064.926828:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1788330064.926859:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1788330064.926877:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1788330064.926889:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788330064.926891:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788330064.927523:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1788330064.927860:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1788330064.927888:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1788330064.927918:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1788330064.927931:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788330064.927934:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788330064.928842:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1788330064.929497:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1788330064.929532:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1788330064.929550:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:0.0:1788330064.929580:0:10335:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788330064.929617:0:10335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99eef58c2000/0x8475908e9fd0ec7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.929641:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef59ca800/0x8475908e9fd0d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0d5b expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.929649:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eec147b600/0x8475908e9fd0d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0d85 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.929656:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0dcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0dc4 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.929664:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ef02064000/0x8475908e9fd0dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0dd2 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.929670:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ef02065000/0x8475908e9fd0de7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0de0 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.929676:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eec147b200/0x8475908e9fd0e03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0dfc expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.929683:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0e2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0e26 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.929690:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99edc765a400/0x8475908e9fd0e49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0e42 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.929705:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef58c3400/0x8475908e9fd0e6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0e65 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.929716:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef58c2a00/0x8475908e9fd0e81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105c9e expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.929734:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef58c3000/0x8475908e9fd0e88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ca5 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.929743:0:10335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99eef58c2000/0x8475908e9fd0ec7 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.929804:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef58c3000/0x8475908e9fd0e88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ca5 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.929824:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eef58c3000/0x8475908e9fd0e88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ca5 expref: 9 pid: 6516 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330064.929846:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792306432:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330064.929997:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef58c2a00/0x8475908e9fd0e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105c9e expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.930007:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eef58c2a00/0x8475908e9fd0e81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105c9e expref: 9 pid: 6516 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330064.930016:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792306560:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330064.930044:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef58c3400/0x8475908e9fd0e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0e65 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.930063:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eef58c3400/0x8475908e9fd0e6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0e65 expref: 23 pid: 6516 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330064.930075:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792306688:0@lo:104: 00000100:00100000:0.0:1788330064.930126:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330064.930257:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99edc765a400/0x8475908e9fd0e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0e42 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.930266:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99edc765a400/0x8475908e9fd0e49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0e42 expref: 23 pid: 6517 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330064.930275:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792306816:0@lo:104: 00000100:00100000:0.0:1788330064.930294:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330064.932322:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0e26 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.932344:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0e2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0e26 expref: 23 pid: 6516 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330064.932362:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792306944:0@lo:104: 00000100:00100000:0.0:1788330064.932430:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330064.932513:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792306688 00000100:00100000:3.0:1788330064.932524:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792306688 00000100:00100000:3.0:1788330064.932587:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792306816 00000100:00100000:3.0:1788330064.932591:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792306816 00000100:00100000:3.0:1788330064.932633:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788330064.932644:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:10335:x1875199792306688:12345-0@lo:104: 00010000:00010000:3.0:1788330064.932659:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd0e65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0e6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.932867:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eec147b200/0x8475908e9fd0e03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0dfc expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.932878:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eec147b200/0x8475908e9fd0e03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0dfc expref: 23 pid: 6517 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330064.932887:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792307072:0@lo:104: 00000100:00100000:0.0:1788330064.932927:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330064.932950:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ef02065000/0x8475908e9fd0de7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0de0 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.932958:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ef02065000/0x8475908e9fd0de7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0de0 expref: 23 pid: 6516 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330064.932966:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792307200:0@lo:104: 00010000:00010000:0.0:1788330064.932995:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ef02064000/0x8475908e9fd0dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0dd2 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.933003:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ef02064000/0x8475908e9fd0dd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0dd2 expref: 23 pid: 6517 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330064.933011:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792307328:0@lo:104: 00010000:00010000:0.0:1788330064.933056:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0dcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0dc4 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.933064:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0dcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0dc4 expref: 23 pid: 6516 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330064.933072:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792307456:0@lo:104: 00010000:00010000:0.0:1788330064.933101:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eec147b600/0x8475908e9fd0d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0d85 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.933109:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eec147b600/0x8475908e9fd0d8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0d85 expref: 23 pid: 6517 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330064.933118:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792307584:0@lo:104: 00010000:00010000:0.0:1788330064.933143:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef59ca800/0x8475908e9fd0d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0d5b expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.933179:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eef59ca800/0x8475908e9fd0d62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0d5b expref: 23 pid: 6515 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330064.933188:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792307712:0@lo:104: 00000100:00100000:0.0:1788330064.933214:0:10335:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59cda80 going to sleep for 11 seconds 00000100:00100000:0.0:1788330064.933245:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792306688:0@lo:104: 00010000:00010000:3.0:1788330064.933344:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788330064.933353:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:10335:x1875199792306688:12345-0@lo:104: Request processed in 710us (3227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330064.933362:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788330064.933403:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788330064.933424:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330064.933440:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330064.933451:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330064.933461:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330064.933469:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330064.933476:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792306944 00000100:00100000:3.0:1788330064.933480:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792306944 00000100:00100000:3.0:1788330064.933498:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792307072 00000100:00100000:3.0:1788330064.933501:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792307072 00000100:00100000:3.0:1788330064.933510:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792307200 00000100:00100000:3.0:1788330064.933512:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792307200 00000100:00100000:3.0:1788330064.933520:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792307328 00000100:00100000:3.0:1788330064.933522:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792307328 00000100:00100000:3.0:1788330064.933530:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792307456 00000100:00100000:3.0:1788330064.933533:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792307456 00000100:00100000:3.0:1788330064.933541:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792307584 00000100:00100000:3.0:1788330064.933543:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792307584 00000100:00100000:3.0:1788330064.933552:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792307712 00000100:00100000:3.0:1788330064.933554:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792307712 00000100:00100000:3.0:1788330064.933581:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788330064.933588:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+10:10335:x1875199792306816:12345-0@lo:104: 00010000:00010000:3.0:1788330064.933619:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99edc765b200/0x8475908e9fd0e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0e49 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.933673:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788330064.933678:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+10:10335:x1875199792306816:12345-0@lo:104: Request processed in 91us (3384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330064.933684:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788330064.933699:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788330064.933705:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+9:10335:x1875199792306944:12345-0@lo:104: 00010000:00010000:3.0:1788330064.933712:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0e2d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.933872:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788330064.933877:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+9:10335:x1875199792306944:12345-0@lo:104: Request processed in 173us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330064.933883:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788330064.933896:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788330064.933902:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef70ae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+8:10335:x1875199792307072:12345-0@lo:104: 00010000:00010000:3.0:1788330064.933910:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef58c3c00/0x8475908e9fd0dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0e03 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.933938:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788330064.933943:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef70ae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+8:10335:x1875199792307072:12345-0@lo:104: Request processed in 42us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330064.933948:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788330064.933984:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788330064.933989:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+7:10335:x1875199792307200:12345-0@lo:104: 00010000:00010000:3.0:1788330064.934003:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0de0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0de7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.934031:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788330064.934036:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+7:10335:x1875199792307200:12345-0@lo:104: Request processed in 48us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330064.934042:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788330064.934055:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788330064.934060:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+6:10335:x1875199792307328:12345-0@lo:104: 00010000:00010000:3.0:1788330064.934068:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0dd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0dd9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.934092:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788330064.934097:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+6:10335:x1875199792307328:12345-0@lo:104: Request processed in 37us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330064.934102:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788330064.934113:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788330064.934118:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+5:10335:x1875199792307456:12345-0@lo:104: 00010000:00010000:3.0:1788330064.934126:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0dcb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.934173:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1788330064.934178:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+5:10335:x1875199792307456:12345-0@lo:104: Request processed in 60us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330064.934185:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788330064.934196:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788330064.934202:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:10335:x1875199792307584:12345-0@lo:104: 00010000:00010000:3.0:1788330064.934215:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd0d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0d8c expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.934241:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:3.0:1788330064.934246:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:10335:x1875199792307584:12345-0@lo:104: Request processed in 45us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330064.934252:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788330064.934263:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788330064.934268:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:10335:x1875199792307712:12345-0@lo:104: 00010000:00010000:3.0:1788330064.934276:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0d62 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.934300:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:3.0:1788330064.934305:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:10335:x1875199792307712:12345-0@lo:104: Request processed in 37us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330064.934310:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1788330064.934331:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788330064.934338:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd0e65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0e6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.934346:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147ac00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330064.934350:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd0e65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0e6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.934360:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd0e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0e6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330064.934368:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd0e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0e6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330064.934382:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788330064.934426:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd0e65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0e6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.934433:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330064.934455:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd0e65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0e6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.934464:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec147ac00/0x8475908e9fd0e65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0e6c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.934482:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788330064.934486:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99edc765b200/0x8475908e9fd0e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0e49 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.934491:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765b200 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330064.934494:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99edc765b200/0x8475908e9fd0e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0e49 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.934500:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99edc765b200/0x8475908e9fd0e42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0e49 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330064.934506:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99edc765b200/0x8475908e9fd0e42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0e49 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330064.934511:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788330064.934523:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99edc765b200/0x8475908e9fd0e42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0e49 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.934528:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330064.934551:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99edc765b200/0x8475908e9fd0e42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0e49 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.934557:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99edc765b200/0x8475908e9fd0e42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0e49 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.934579:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788330064.934582:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0e2d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.934587:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c2400 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330064.934590:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0e2d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330064.934707:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00000100:00100000:0.0:1788330064.934771:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792306816:0@lo:104: 00000100:00100000:0.0:1788330064.934782:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792306944:0@lo:104: 00000100:00100000:0.0:1788330064.934790:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792307072:0@lo:104: 00000100:00100000:0.0:1788330064.934797:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792307200:0@lo:104: 00000100:00100000:0.0:1788330064.934803:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792307328:0@lo:104: 00000100:00100000:0.0:1788330064.934810:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792307456:0@lo:104: 00000100:00100000:0.0:1788330064.934816:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792307584:0@lo:104: 00000100:00100000:0.0:1788330064.934822:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792307712:0@lo:104: 00010000:00010000:3.0:1788330064.935019:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0e2d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330064.935027:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0e2d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330064.935033:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788330064.935050:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0e26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0e2d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.935057:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330064.935063:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0e26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0e2d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.935069:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef58c2400/0x8475908e9fd0e26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0e2d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.935080:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788330064.935090:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0de0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0de7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.935097:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c3600 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330064.935099:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0de0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0de7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.935106:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0de7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330064.935113:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0de7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330064.935119:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788330064.935133:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0de0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0de7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.935140:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330064.935146:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0de0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0de7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330064.935243:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792308096:0@lo:103: 00000100:00100000:0.0:1788330064.935298:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330064.935360:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788330064.935367:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792307968:0@lo:103: 00000100:00100000:0.0:1788330064.935390:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330064.935424:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792308224:0@lo:103: 00000100:00100000:0.0:1788330064.935448:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330064.935464:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330064.935478:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792307840:0@lo:103: 00000100:00100000:0.0:1788330064.935502:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330064.935590:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792308096 00000100:00100000:1.0:1788330064.935608:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792308096 00010000:00010000:1.0:1788330064.935644:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0e2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0e26 expref: 24 pid: 6516 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330064.935663:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792307968 00000100:00100000:1.0:1788330064.935666:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792307968 00010000:00010000:1.0:1788330064.935675:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99edc765a400/0x8475908e9fd0e49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0e42 expref: 25 pid: 6517 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330064.935685:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792308224 00000100:00100000:1.0:1788330064.935687:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792308224 00010000:00010000:1.0:1788330064.935696:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ef02065000/0x8475908e9fd0de7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0de0 expref: 26 pid: 6516 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330064.935706:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792307840 00000100:00100000:1.0:1788330064.935716:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792307840 00010000:00010000:1.0:1788330064.935735:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef58c3400/0x8475908e9fd0e6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0e65 expref: 27 pid: 6516 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330064.935750:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788330064.935759:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec986c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+27:3647:x1875199792308096:12345-0@lo:103: 00010000:00010000:1.0:1788330064.935774:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330064.935781:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0e2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0e26 expref: 27 pid: 6516 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330064.935792:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0e26 expref: 27 pid: 6516 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330064.935811:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ef02065c00/0x8475908e9fd0e2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0e26 expref: 27 pid: 6516 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330064.935830:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330064.935875:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec986c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+26:3647:x1875199792308096:12345-0@lo:103: Request processed in 117us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330064.935882:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788330064.935931:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788330064.935938:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+25:3647:x1875199792307968:12345-0@lo:103: 00010000:00010000:1.0:1788330064.935945:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330064.935950:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99edc765a400/0x8475908e9fd0e49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0e42 expref: 25 pid: 6517 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330064.935959:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99edc765a400/0x8475908e9fd0e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0e42 expref: 25 pid: 6517 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330064.935969:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99edc765a400/0x8475908e9fd0e49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0e42 expref: 25 pid: 6517 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330064.935985:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330064.936009:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792307968:12345-0@lo:103: Request processed in 72us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330064.936015:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788330064.936027:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788330064.936033:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:3648:x1875199792308224:12345-0@lo:103: 00010000:00010000:1.0:1788330064.936041:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330064.936044:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ef02065000/0x8475908e9fd0de7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0de0 expref: 23 pid: 6516 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330064.936052:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ef02065000/0x8475908e9fd0de7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0de0 expref: 23 pid: 6516 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330064.936062:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ef02065000/0x8475908e9fd0de7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0de0 expref: 23 pid: 6516 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330064.936070:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330064.936098:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:3648:x1875199792308224:12345-0@lo:103: Request processed in 65us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330064.936103:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788330064.936116:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788330064.936122:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:3648:x1875199792307840:12345-0@lo:103: 00010000:00010000:1.0:1788330064.936129:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330064.936133:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef58c3400/0x8475908e9fd0e6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0e65 expref: 21 pid: 6516 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330064.936141:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef58c3400/0x8475908e9fd0e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0e65 expref: 21 pid: 6516 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330064.936187:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c3400/0x8475908e9fd0e6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0e65 expref: 21 pid: 6516 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330064.936197:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330064.936220:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:3648:x1875199792307840:12345-0@lo:103: Request processed in 99us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330064.936226:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788330064.936272:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792307840:0@lo:103: 00000100:00100000:1.0:1788330064.936282:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792308224:0@lo:103: 00010000:00010000:3.0:1788330064.936649:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef58c3600/0x8475908e9fd0de0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0de7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936663:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788330064.936668:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0dd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0dd9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936674:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147b000 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330064.936678:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0dd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0dd9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936699:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0dd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0dd9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330064.936706:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0dd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0dd9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330064.936712:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788330064.936736:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0dd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0dd9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936743:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330064.936761:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0dd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0dd9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936768:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec147b000/0x8475908e9fd0dd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0dd9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936778:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788330064.936781:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0dcb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936787:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147be00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330064.936790:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0dcb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936797:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0dcb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330064.936803:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0dcb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330064.936814:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788330064.936827:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0dc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0dcb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936832:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330064.936841:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0dc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0dcb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936849:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec147be00/0x8475908e9fd0dc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0dcb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936857:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330064.936860:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd0d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0d8c expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936865:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02064e00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330064.936868:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd0d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0d8c expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936875:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd0d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0d8c expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330064.936882:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd0d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0d8c expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330064.936887:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788330064.936896:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd0d85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0d8c expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936901:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330064.936911:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd0d85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0d8c expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936917:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99ef02064e00/0x8475908e9fd0d85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0d8c expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936931:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330064.936934:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0d62 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936940:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147ba00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330064.936942:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0d62 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936950:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0d62 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330064.936957:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0d62 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330064.936962:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788330064.936974:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0d5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0d62 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936980:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330064.936985:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0d5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0d62 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936991:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd0d5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0d62 expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.936999:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330064.937005:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330064.937007:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330064.937025:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792308480:0@lo:103: 00000100:00100000:3.0:1788330064.937066:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330064.937102:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330064.937107:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792308608:0@lo:103: 00000100:00100000:3.0:1788330064.937122:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330064.937141:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792308352:0@lo:103: 00000100:00100000:0.0:1788330064.937279:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792307968:0@lo:103: 00000100:00100000:0.0:1788330064.937289:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792308096:0@lo:103: 00000100:00100000:1.0:1788330064.937441:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792308480 00000100:00100000:1.0:1788330064.937449:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792308480 00010000:00010000:1.0:1788330064.937476:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0dcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0dc4 expref: 20 pid: 6516 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330064.937499:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792308608 00000100:00100000:1.0:1788330064.937502:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792308608 00010000:00010000:1.0:1788330064.937510:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eec147b600/0x8475908e9fd0d8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0d85 expref: 21 pid: 6517 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330064.937526:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788330064.937533:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:3646:x1875199792308480:12345-0@lo:103: 00010000:00010000:1.0:1788330064.937544:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330064.937548:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0dcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0dc4 expref: 21 pid: 6516 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330064.937568:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0dcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0dc4 expref: 21 pid: 6516 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330064.937594:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0dcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0dc4 expref: 21 pid: 6516 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330064.937689:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792306432:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330064.937698:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875199792306560:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330064.937748:0:10335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99eef58c2000/0x8475908e9fd0ec7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330064.937802:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330064.937876:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:3646:x1875199792308480:12345-0@lo:103: Request processed in 342us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330064.937883:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788330064.937899:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788330064.937905:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:3646:x1875199792308608:12345-0@lo:103: 00010000:00010000:1.0:1788330064.937914:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330064.937919:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eec147b600/0x8475908e9fd0d8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0d85 expref: 19 pid: 6517 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330064.937927:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eec147b600/0x8475908e9fd0d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0d85 expref: 19 pid: 6517 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330064.937937:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec147b600/0x8475908e9fd0d8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0d85 expref: 19 pid: 6517 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330064.937946:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330064.937964:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:3646:x1875199792308608:12345-0@lo:103: Request processed in 60us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330064.937970:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788330064.938135:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330064.938180:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330064.938189:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792308736:0@lo:103: 00000100:00100000:3.0:1788330064.938213:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330064.938233:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792308352 00000100:00100000:3.0:1788330064.938237:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792308352 00010000:00010000:3.0:1788330064.938255:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ef02064000/0x8475908e9fd0dd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0dd2 expref: 18 pid: 6517 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330064.938270:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792308736 00000100:00100000:3.0:1788330064.938273:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792308736 00010000:00010000:3.0:1788330064.938298:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef59ca800/0x8475908e9fd0d62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0d5b expref: 19 pid: 6515 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330064.938310:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788330064.938315:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:3649:x1875199792308352:12345-0@lo:103: 00010000:00010000:3.0:1788330064.938322:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330064.938326:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ef02064000/0x8475908e9fd0dd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0dd2 expref: 19 pid: 6517 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.938335:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ef02064000/0x8475908e9fd0dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0dd2 expref: 19 pid: 6517 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.938350:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ef02064000/0x8475908e9fd0dd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0dd2 expref: 19 pid: 6517 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.938362:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330064.938386:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:3649:x1875199792308352:12345-0@lo:103: Request processed in 70us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330064.938392:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788330064.938405:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788330064.938410:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec986dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:3649:x1875199792308736:12345-0@lo:103: 00010000:00010000:3.0:1788330064.938417:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330064.938421:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef59ca800/0x8475908e9fd0d62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0d5b expref: 17 pid: 6515 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.938430:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef59ca800/0x8475908e9fd0d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0d5b expref: 17 pid: 6515 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.938439:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef59ca800/0x8475908e9fd0d62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0d5b expref: 17 pid: 6515 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.938448:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330064.938463:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec986dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:3649:x1875199792308736:12345-0@lo:103: Request processed in 54us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330064.938468:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788330064.938516:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792308736:0@lo:103: 00000100:00100000:3.0:1788330064.938524:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792308352:0@lo:103: 00010000:00010000:3.0:1788330064.938715:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330064.938723:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef58c3c00/0x8475908e9fd0dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0e03 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.938737:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c3c00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330064.938742:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c3c00/0x8475908e9fd0dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0e03 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.938751:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef58c3c00/0x8475908e9fd0dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0e03 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330064.938758:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c3c00/0x8475908e9fd0dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0e03 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330064.938764:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788330064.938788:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef58c3c00/0x8475908e9fd0dfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0e03 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.938794:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330064.938806:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef58c3c00/0x8475908e9fd0dfc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0e03 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.938813:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef58c3c00/0x8475908e9fd0dfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0e03 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.938828:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330064.938830:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330064.938831:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330064.938839:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792308864:0@lo:103: 00000100:00100000:3.0:1788330064.938861:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330064.938882:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792308864 00000100:00100000:3.0:1788330064.938885:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792308864 00010000:00010000:3.0:1788330064.938898:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eec147b200/0x8475908e9fd0e03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0dfc expref: 16 pid: 6517 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330064.938922:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788330064.938928:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:3649:x1875199792308864:12345-0@lo:103: 00010000:00010000:3.0:1788330064.938936:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330064.938940:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eec147b200/0x8475908e9fd0e03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0dfc expref: 16 pid: 6517 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.938949:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eec147b200/0x8475908e9fd0e03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0dfc expref: 16 pid: 6517 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.938959:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec147b200/0x8475908e9fd0e03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0dfc expref: 16 pid: 6517 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.938968:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330064.938990:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:3649:x1875199792308864:12345-0@lo:103: Request processed in 63us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330064.938995:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788330064.939016:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792308864:0@lo:103: 00010000:00010000:3.0:1788330064.939025:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330064.939027:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330064.939390:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330064.939441:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766041344 00000100:00100000:2.0:1788330064.939446:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766041344 00010000:00010000:2.0:1788330064.939470:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef58c3000/0x8475908e9fd0e88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ca5 expref: 10 pid: 6516 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330064.939497:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:2.0:1788330064.939503:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2413:x1875199766041344:12345-192.168.202.50@tcp:103: 00010000:00010000:2.0:1788330064.939512:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330064.939516:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef58c3000/0x8475908e9fd0e88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ca5 expref: 10 pid: 6516 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330064.939527:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef58c3000/0x8475908e9fd0e88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ca5 expref: 10 pid: 6516 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330064.939537:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c3000/0x8475908e9fd0e88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ca5 expref: 10 pid: 6516 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330064.939546:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330064.939611:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa3490c8-da14-415b-81e3-af4ba0c476db+9:2413:x1875199766041344:12345-192.168.202.50@tcp:103: Request processed in 107us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330064.939617:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:1.0:1788330064.940086:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330064.940138:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766041472 00000100:00100000:3.0:1788330064.940143:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766041472 00010000:00010000:3.0:1788330064.940266:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef58c2a00/0x8475908e9fd0e81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105c9e expref: 9 pid: 6516 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330064.940301:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:3.0:1788330064.940309:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa3490c8-da14-415b-81e3-af4ba0c476db+9:2412:x1875199766041472:12345-192.168.202.50@tcp:103: 00010000:00010000:3.0:1788330064.940317:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330064.940332:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef58c2a00/0x8475908e9fd0e81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105c9e expref: 9 pid: 6516 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.940344:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef58c2a00/0x8475908e9fd0e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105c9e expref: 9 pid: 6516 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.940357:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c2a00/0x8475908e9fd0e81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105c9e expref: 9 pid: 6516 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.940375:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99eef58c2000/0x8475908e9fd0ec7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.940383:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef58c2000/0x8475908e9fd0ec7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.940401:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eef58c2000/0x8475908e9fd0ec7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.940410:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eef58c2000/0x8475908e9fd0ec7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.940418:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99eef58c2000/0x8475908e9fd0ec7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.940424:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99eef58c2000/0x8475908e9fd0ec7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.940431:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c2000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330064.940436:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99eef58c2000/0x8475908e9fd0ec7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.940445:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99eef58c2000/0x8475908e9fd0ec7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330064.940655:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792308480:0@lo:103: 00000100:00100000:0.0:1788330064.940682:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792308608:0@lo:103: 00010000:00010000:2.0:1788330064.940860:0:10335:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99eef58c2000/0x8475908e9fd0ec7 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330064.940870:0:10335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99eef58c2000/0x8475908e9fd0ec7 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.941880:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99eef58c2000/0x8475908e9fd0ec7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.941898:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c2000/0x8475908e9fd0ec7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330064.941919:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330064.942011:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa3490c8-da14-415b-81e3-af4ba0c476db+8:2412:x1875199766041472:12345-192.168.202.50@tcp:103: Request processed in 1696us (1918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330064.942023:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 34 00010000:00010000:3.0:1788330065.819814:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788330066.011727:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788330066.011759:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99eef6de3800 from 48 10000000:01000000:2.0:1788330066.011766:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788330066.011832:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765b000/0x8475908e9fd0ece lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330066.011846:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99edc765b000/0x8475908e9fd0ece lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330066.011860:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99edc765b000/0x8475908e9fd0ece lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330066.011891:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792308992:0@lo:101: 00000100:00100000:2.0:1788330066.011987:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330066.014144:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10a5840 going to sleep for 11 seconds 00000100:00100000:0.0:1788330066.015744:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792308992 00000100:00100000:0.0:1788330066.015763:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792308992 00000100:00100000:0.0:1788330066.015934:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788330066.015952:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+15:6519:x1875199792308992:12345-0@lo:101: 00010000:00010000:0.0:1788330066.015976:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330066.016006:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef58c2400/0x8475908e9fd0ed5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0ece expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.016048:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef58c2400/0x8475908e9fd0ed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0ece expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.016062:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef58c2400/0x8475908e9fd0ed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0ece expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.016075:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c2400, rc 0) 00000100:00100000:0.0:1788330066.016244:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792308992:12345-0@lo:101: Request processed in 297us (4257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.016251:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788330066.016384:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792308992:0@lo:101: 00010000:00010000:1.0:1788330066.016410:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99edc765b000/0x8475908e9fd0ece lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ed5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.016430:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99edc765b000/0x8475908e9fd0ece lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0ed5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330066.016589:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792309120:0@lo:501: 00000100:00100000:1.0:1788330066.016645:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.017790:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef408c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788330066.017878:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792309120 00000100:00100000:2.0:1788330066.017890:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792309120 00000100:00100000:2.0:1788330066.017943:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788330066.017953:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792309120:12345-0@lo:501: 00000100:00100000:2.0:1788330066.018171:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792309120:12345-0@lo:501: Request processed in 218us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330066.018179:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788330066.018347:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792309120:0@lo:501: 00000100:00100000:1.0:1788330066.018407:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792309248:0@lo:503: 00000100:00100000:1.0:1788330066.018469:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.018508:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef408c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788330066.019061:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792309248 00000100:00100000:0.0:1788330066.019069:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792309248 00000100:00100000:0.0:1788330066.019114:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788330066.019124:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792309248:12345-0@lo:503: 00000100:00100000:0.0:1788330066.019752:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792309248:12345-0@lo:503: Request processed in 626us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.019762:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788330066.020139:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792309248:0@lo:503: 00000100:00100000:1.0:1788330066.020891:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10354:1875199792309376:0@lo:502: 00000100:00100000:1.0:1788330066.020973:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.021020:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef408c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330066.021084:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792309376 00000100:00100000:0.0:1788330066.021272:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792309376 00000100:00100000:0.0:1788330066.021749:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788330066.021763:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:10354:x1875199792309376:12345-0@lo:502: 00000100:00100000:0.0:1788330066.021954:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:10354:x1875199792309376:12345-0@lo:502: Request processed in 193us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.021962:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788330066.022061:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10354:1875199792309376:0@lo:502: 00000100:00100000:1.0:1788330066.022136:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10354:1875199792309504:0@lo:502: 00000100:00100000:1.0:1788330066.022203:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.022522:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef408c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330066.022756:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792309504 00000100:00100000:2.0:1788330066.022766:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792309504 00000100:00100000:2.0:1788330066.022804:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788330066.022815:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:10354:x1875199792309504:12345-0@lo:502: 00000100:00100000:2.0:1788330066.022943:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:10354:x1875199792309504:12345-0@lo:502: Request processed in 130us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330066.022951:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788330066.023053:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10354:1875199792309504:0@lo:502: 00000040:00080000:1.0:1788330066.023085:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788330066.023465:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788330066.023508:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788330066.023522:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765b000/0x8475908e9fd0ece lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ed5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330066.023535:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99edc765b000/0x8475908e9fd0ece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ed5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330066.023557:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788330066.023561:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788330066.023565:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788330066.023619:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765ae00/0x8475908e9fd0edc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330066.023629:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99edc765ae00/0x8475908e9fd0edc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330066.023639:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99edc765ae00/0x8475908e9fd0edc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330066.023661:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792309632:0@lo:101: 00000100:00100000:2.0:1788330066.023705:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330066.023751:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10a5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788330066.023880:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792309632 00000100:00100000:0.0:1788330066.023888:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792309632 00000100:00100000:0.0:1788330066.023935:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788330066.023945:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+16:6519:x1875199792309632:12345-0@lo:101: 00010000:00010000:0.0:1788330066.023957:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330066.023972:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef58c3800/0x8475908e9fd0ee3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0edc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.023999:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef58c3800/0x8475908e9fd0ee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0edc expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.024025:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef58c3800/0x8475908e9fd0ee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0edc expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.024036:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c3800, rc 0) 00000100:00100000:0.0:1788330066.024091:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792309632:12345-0@lo:101: Request processed in 148us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.024098:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788330066.024235:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792309632:0@lo:101: 00010000:00010000:1.0:1788330066.024252:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99edc765ae00/0x8475908e9fd0edc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ee3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.024273:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99edc765ae00/0x8475908e9fd0edc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0ee3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330066.024371:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792309760:0@lo:501: 00000100:00100000:1.0:1788330066.024404:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.024429:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef408c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330066.024531:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792309760 00000100:00100000:0.0:1788330066.024536:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792309760 00000100:00100000:0.0:1788330066.024568:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788330066.024575:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792309760:12345-0@lo:501: 00000100:00100000:0.0:1788330066.024728:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792309760:12345-0@lo:501: Request processed in 153us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.024734:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788330066.026609:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792309760:0@lo:501: 00000100:00100000:1.0:1788330066.026692:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792309888:0@lo:503: 00000100:00100000:1.0:1788330066.026791:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.026840:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef408c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330066.026930:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792309888 00000100:00100000:0.0:1788330066.026940:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792309888 00000100:00100000:0.0:1788330066.027004:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788330066.027019:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792309888:12345-0@lo:503: 00000100:00100000:0.0:1788330066.027237:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792309888:12345-0@lo:503: Request processed in 220us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.027247:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788330066.027600:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792309888:0@lo:503: 00000100:00100000:1.0:1788330066.030723:0:10355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10355:1875199792310016:0@lo:502: 00000100:00100000:1.0:1788330066.030836:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.030934:0:10355:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef408c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330066.030979:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792310016 00000100:00100000:0.0:1788330066.030989:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792310016 00000100:00100000:0.0:1788330066.031084:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788330066.031097:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:10355:x1875199792310016:12345-0@lo:502: 00000100:00100000:0.0:1788330066.031363:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:10355:x1875199792310016:12345-0@lo:502: Request processed in 267us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.031380:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788330066.031492:0:10355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10355:1875199792310016:0@lo:502: 00000020:01000000:2.0:1788330066.031543:0:10355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330066.031567:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330066.031570:0:10355:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788330066.031579:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788330066.031610:0:10355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10355:1875199792310144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330066.031652:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330066.031834:0:10355:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10a5900 going to sleep for 11 seconds 00000100:00100000:1.0:1788330066.031880:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792310144 00000100:00100000:1.0:1788330066.031885:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792310144 00000100:00100000:1.0:1788330066.031917:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788330066.031925:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:10355:x1875199792310144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330066.032031:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:10355:x1875199792310144:12345-0@lo:502:llog_process_th.0 Request processed in 106us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330066.032039:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788330066.032111:0:10355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10355:1875199792310144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788330066.032131:0:10355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330066.032135:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330066.032137:0:10355:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788330066.032142:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1788330066.032442:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788330066.032470:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788330066.032483:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765ae00/0x8475908e9fd0edc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ee3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.032583:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99edc765ae00/0x8475908e9fd0edc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ee3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330066.032594:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788330066.032597:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99eefe782800 from 48 10000000:01000000:1.0:1788330066.032601:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788330066.032636:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78800/0x8475908e9fd0eea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.032643:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef6e78800/0x8475908e9fd0eea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.032653:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef6e78800/0x8475908e9fd0eea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330066.032669:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792310272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788330066.032705:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.032732:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef408c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330066.032746:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792310272 00000100:00100000:1.0:1788330066.032750:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792310272 00000100:00100000:1.0:1788330066.032775:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788330066.032782:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+17:6519:x1875199792310272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330066.032794:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330066.032808:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef6e79a00/0x8475908e9fd0ef1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0eea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.032837:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e79a00/0x8475908e9fd0ef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0eea expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.032861:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef6e79a00/0x8475908e9fd0ef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0eea expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.032871:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79a00, rc 0) 00000100:00100000:1.0:1788330066.032903:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792310272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330066.032908:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788330066.032941:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792310272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330066.032954:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef6e78800/0x8475908e9fd0eea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ef1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.032963:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef6e78800/0x8475908e9fd0eea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0ef1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330066.033016:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792310400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330066.033042:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.033054:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef408c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330066.033064:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792310400 00000100:00100000:1.0:1788330066.033068:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792310400 00000100:00100000:1.0:1788330066.033084:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788330066.033090:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792310400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330066.033253:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792310400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330066.033260:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788330066.033646:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792310400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330066.033695:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792310528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330066.033738:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.033773:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788330066.033854:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792310528 00000100:00100000:3.0:1788330066.033859:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792310528 00000100:00100000:3.0:1788330066.033889:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788330066.033896:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792310528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330066.035059:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792310528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1156us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330066.035072:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788330066.035836:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792310528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330066.037781:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10356:1875199792310656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330066.037900:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330066.037962:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10a5240 going to sleep for 11 seconds 00000100:00100000:3.0:1788330066.038032:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792310656 00000100:00100000:3.0:1788330066.038042:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792310656 00000100:00100000:3.0:1788330066.038107:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788330066.038120:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:10356:x1875199792310656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330066.038320:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:10356:x1875199792310656:12345-0@lo:502:llog_process_th.0 Request processed in 201us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330066.038330:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788330066.038436:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10356:1875199792310656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788330066.038586:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10356:1875199792310784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788330066.038626:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330066.038655:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792310784 00000100:00100000:0.0:1788330066.038659:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792310784 00000100:00100000:0.0:1788330066.038682:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788330066.038688:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:10356:x1875199792310784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788330066.038755:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:10356:x1875199792310784:12345-0@lo:502:llog_process_th.0 Request processed in 65us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.038762:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788330066.038795:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eed31b5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788330066.038806:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10356:1875199792310784:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788330066.038825:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788330066.038904:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788330066.038932:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788330066.038944:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78800/0x8475908e9fd0eea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ef1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.038956:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef6e78800/0x8475908e9fd0eea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ef1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330066.038966:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788330066.038970:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788330066.038979:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788330066.039008:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2000/0x8475908e9fd0ef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.039017:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef58c2000/0x8475908e9fd0ef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.039027:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef58c2000/0x8475908e9fd0ef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330066.039040:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792310912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788330066.039067:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330066.039081:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee72630c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330066.039092:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792310912 00000100:00100000:0.0:1788330066.039096:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792310912 00000100:00100000:0.0:1788330066.039112:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788330066.039118:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+18:6519:x1875199792310912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330066.039126:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330066.039140:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef58c2a00/0x8475908e9fd0eff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0ef8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.039194:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef58c2a00/0x8475908e9fd0eff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0ef8 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.039205:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef58c2a00/0x8475908e9fd0eff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0ef8 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.039216:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c2a00, rc 0) 00000100:00100000:0.0:1788330066.039244:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:6519:x1875199792310912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.039262:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788330066.039296:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792310912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330066.039310:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef58c2000/0x8475908e9fd0ef8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0eff expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.039321:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2000/0x8475908e9fd0ef8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0eff expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330066.039369:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792311040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330066.039393:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330066.039405:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee72630c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330066.039414:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792311040 00000100:00100000:0.0:1788330066.039417:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792311040 00000100:00100000:0.0:1788330066.039433:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788330066.039438:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:6519:x1875199792311040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330066.040495:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:6519:x1875199792311040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1051us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.040516:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788330066.040652:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792311040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330066.040700:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792311168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330066.040750:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330066.040814:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10a5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788330066.040845:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792311168 00000100:00100000:3.0:1788330066.040851:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792311168 00000100:00100000:3.0:1788330066.040925:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788330066.040934:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:6519:x1875199792311168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330066.041040:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:6519:x1875199792311168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330066.041048:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788330066.041120:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792311168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330066.041617:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10357:1875199792311296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788330066.041663:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330066.041699:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7263c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788330066.042118:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792311296 00000100:00100000:1.0:1788330066.042126:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792311296 00000100:00100000:1.0:1788330066.042204:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788330066.042213:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:10357:x1875199792311296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330066.042333:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:10357:x1875199792311296:12345-0@lo:502:llog_process_th.0 Request processed in 121us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330066.042341:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788330066.042807:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10357:1875199792311296:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788330066.042845:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788330066.042863:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330066.042865:0:10357:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788330066.042871:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788330066.042909:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10357:1875199792311424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788330066.042955:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330066.042993:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7263c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788330066.044307:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792311424 00000100:00100000:1.0:1788330066.044321:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792311424 00000100:00100000:1.0:1788330066.044380:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788330066.044391:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:10357:x1875199792311424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330066.044720:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:10357:x1875199792311424:12345-0@lo:502:llog_process_th.0 Request processed in 329us (1764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330066.044728:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788330066.044832:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10357:1875199792311424:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788330066.044872:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330066.044882:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330066.044884:0:10357:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788330066.044892:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1788330066.045097:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788330066.045124:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788330066.045137:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2000/0x8475908e9fd0ef8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0eff expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.045228:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef58c2000/0x8475908e9fd0ef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0eff expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330066.045242:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788330066.045245:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99eef59c6800 from 48 10000000:01000000:1.0:1788330066.045257:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788330066.045296:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78600/0x8475908e9fd0f06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.045306:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef6e78600/0x8475908e9fd0f06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.045317:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef6e78600/0x8475908e9fd0f06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330066.045340:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792311552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788330066.045388:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.045464:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788330066.046453:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792311552 00000100:00100000:3.0:1788330066.046464:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792311552 00000100:00100000:3.0:1788330066.046527:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788330066.046538:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:6519:x1875199792311552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330066.046566:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330066.046584:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef59ca800/0x8475908e9fd0f0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0f06 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330066.046673:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef59ca800/0x8475908e9fd0f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0f06 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330066.046685:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef59ca800/0x8475908e9fd0f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0f06 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330066.046696:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59ca800, rc 0) 00000100:00100000:3.0:1788330066.048101:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792311552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1558us (2706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330066.048115:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788330066.049647:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792311552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330066.049683:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef6e78600/0x8475908e9fd0f06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f0d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.049699:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef6e78600/0x8475908e9fd0f06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0f0d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330066.049814:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792311680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330066.049886:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.049973:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788330066.060351:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792311680 00000100:00100000:2.0:1788330066.060373:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792311680 00000100:00100000:2.0:1788330066.060457:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788330066.060471:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792311680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330066.060742:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792311680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (10855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330066.060753:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788330066.060790:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792311680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330066.060868:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792311808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330066.060938:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330066.061035:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59db3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330066.061096:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792311808 00000100:00100000:0.0:1788330066.061101:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792311808 00000100:00100000:0.0:1788330066.061377:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788330066.061388:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792311808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330066.061529:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792311808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.061538:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788330066.061630:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792311808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330066.061998:0:10358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10358:1875199792311936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330066.062049:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330066.070815:0:10358:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59db300 going to sleep for 11 seconds 00000100:00100000:2.0:1788330066.070950:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792311936 00000100:00100000:2.0:1788330066.070966:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792311936 00000100:00100000:2.0:1788330066.071066:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788330066.071079:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:10358:x1875199792311936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330066.071804:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:10358:x1875199792311936:12345-0@lo:502:llog_process_th.0 Request processed in 726us (9752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330066.071816:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788330066.072199:0:10358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10358:1875199792311936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330066.072287:0:10358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10358:1875199792312064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330066.072347:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330066.072446:0:10358:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59db300 going to sleep for 11 seconds 00000100:00100000:1.0:1788330066.079028:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792312064 00000100:00100000:1.0:1788330066.079051:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792312064 00000100:00100000:1.0:1788330066.079139:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788330066.079169:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:10358:x1875199792312064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330066.079431:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:10358:x1875199792312064:12345-0@lo:502:llog_process_th.0 Request processed in 279us (7083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330066.079448:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788330066.079516:0:10358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10358:1875199792312064:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788330066.079578:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788330066.079708:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788330066.079743:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788330066.079757:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78600/0x8475908e9fd0f06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f0d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330066.079770:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef6e78600/0x8475908e9fd0f06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f0d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330066.079782:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788330066.079785:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1788330066.079788:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788330066.079832:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cae00/0x8475908e9fd0f14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330066.079842:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef59cae00/0x8475908e9fd0f14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330066.079852:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef59cae00/0x8475908e9fd0f14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330066.079888:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792312192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788330066.079933:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330066.079979:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59db180 going to sleep for 11 seconds 00000100:00100000:0.0:1788330066.081784:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792312192 00000100:00100000:0.0:1788330066.081800:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792312192 00000100:00100000:0.0:1788330066.081876:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788330066.081889:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792312192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330066.081908:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330066.081929:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef58c3c00/0x8475908e9fd0f1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0f14 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.081966:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef58c3c00/0x8475908e9fd0f1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0f14 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.081979:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef58c3c00/0x8475908e9fd0f1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0f14 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.082007:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c3c00, rc 0) 00000100:00100000:0.0:1788330066.082101:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792312192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (2167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.082108:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788330066.082448:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792312192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330066.082481:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef59cae00/0x8475908e9fd0f14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f1b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.082499:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef59cae00/0x8475908e9fd0f14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0f1b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330066.082796:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792312320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330066.082849:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.082897:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788330066.083174:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792312320 00000100:00100000:2.0:1788330066.083182:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792312320 00000100:00100000:2.0:1788330066.083236:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788330066.083247:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792312320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330066.083785:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792312320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 539us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330066.083794:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788330066.084298:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792312320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330066.084360:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792312448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330066.084423:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.084473:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788330066.084603:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792312448 00000100:00100000:3.0:1788330066.084612:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792312448 00000100:00100000:3.0:1788330066.084663:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788330066.084674:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792312448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330066.084807:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792312448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330066.084817:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788330066.084931:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792312448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330066.088502:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10359:1875199792312576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330066.088648:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.088714:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330066.090286:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792312576 00000100:00100000:2.0:1788330066.090304:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792312576 00000100:00100000:2.0:1788330066.090392:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788330066.090405:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:10359:x1875199792312576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330066.090656:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:10359:x1875199792312576:12345-0@lo:502:llog_process_th.0 Request processed in 252us (2008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330066.090665:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788330066.090846:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10359:1875199792312576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788330066.090894:0:10359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330066.090907:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330066.090910:0:10359:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788330066.090917:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788330066.090976:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10359:1875199792312704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330066.091032:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.091079:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef408c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330066.091141:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792312704 00000100:00100000:0.0:1788330066.091148:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792312704 00000100:00100000:0.0:1788330066.091219:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788330066.091227:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:10359:x1875199792312704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788330066.091322:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:10359:x1875199792312704:12345-0@lo:502:llog_process_th.0 Request processed in 95us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.091329:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788330066.092452:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10359:1875199792312704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788330066.092497:0:10359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330066.092507:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330066.092511:0:10359:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788330066.092515:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1788330066.092744:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1788330066.092773:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788330066.092787:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cae00/0x8475908e9fd0f14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f1b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330066.092799:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef59cae00/0x8475908e9fd0f14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f1b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330066.092812:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788330066.092816:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99eec865b000 from 48 10000000:01000000:3.0:1788330066.092820:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788330066.092862:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cac00/0x8475908e9fd0f22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330066.092872:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef59cac00/0x8475908e9fd0f22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330066.092882:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef59cac00/0x8475908e9fd0f22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330066.092916:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792312832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788330066.092980:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330066.093026:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59db540 going to sleep for 11 seconds 00000100:00100000:0.0:1788330066.093082:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792312832 00000100:00100000:0.0:1788330066.093089:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792312832 00000100:00100000:0.0:1788330066.093146:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788330066.093208:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792312832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330066.093224:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330066.093239:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef58c3600/0x8475908e9fd0f29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0f22 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.093269:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef58c3600/0x8475908e9fd0f29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0f22 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.093280:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef58c3600/0x8475908e9fd0f29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0f22 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.093291:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c3600, rc 0) 00000100:00100000:0.0:1788330066.093341:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792312832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.093357:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788330066.093453:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792312832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330066.093468:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef59cac00/0x8475908e9fd0f22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f29 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330066.093478:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef59cac00/0x8475908e9fd0f22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0f29 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330066.093546:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792312960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330066.093583:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330066.093609:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59db540 going to sleep for 11 seconds 00000100:00100000:2.0:1788330066.093719:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792312960 00000100:00100000:2.0:1788330066.093726:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792312960 00000100:00100000:2.0:1788330066.093767:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788330066.093776:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792312960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330066.093938:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792312960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330066.093945:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788330066.094039:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792312960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330066.094067:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792313088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330066.094104:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330066.094121:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59db540 going to sleep for 11 seconds 00000100:00100000:2.0:1788330066.094167:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792313088 00000100:00100000:2.0:1788330066.094172:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792313088 00000100:00100000:2.0:1788330066.094192:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788330066.094198:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792313088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330066.094304:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792313088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330066.094311:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788330066.094420:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792313088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330066.096187:0:10360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10360:1875199792313216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330066.096417:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330066.096521:0:10360:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59db3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330066.096771:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792313216 00000100:00100000:2.0:1788330066.096780:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792313216 00000100:00100000:2.0:1788330066.096897:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788330066.096911:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:10360:x1875199792313216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330066.097087:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:10360:x1875199792313216:12345-0@lo:502:llog_process_th.0 Request processed in 179us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330066.097096:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788330066.097199:0:10360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10360:1875199792313216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330066.097265:0:10360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10360:1875199792313344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330066.097328:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330066.100145:0:10360:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59db3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330066.100902:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792313344 00000100:00100000:0.0:1788330066.100916:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792313344 00000100:00100000:0.0:1788330066.101002:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788330066.101016:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:10360:x1875199792313344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788330066.101411:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:10360:x1875199792313344:12345-0@lo:502:llog_process_th.0 Request processed in 396us (4080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.101420:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788330066.101627:0:10360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10360:1875199792313344:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788330066.101678:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788330066.101798:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788330066.101829:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788330066.101844:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cac00/0x8475908e9fd0f22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f29 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330066.101857:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef59cac00/0x8475908e9fd0f22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f29 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330066.101870:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788330066.101873:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1788330066.101877:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788330066.101919:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765ac00/0x8475908e9fd0f30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330066.101927:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99edc765ac00/0x8475908e9fd0f30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330066.101947:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99edc765ac00/0x8475908e9fd0f30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330066.101975:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792313472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788330066.102024:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330066.102103:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10a5240 going to sleep for 11 seconds 00000100:00100000:1.0:1788330066.102142:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792313472 00000100:00100000:1.0:1788330066.102253:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792313472 00000100:00100000:1.0:1788330066.102452:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788330066.102462:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792313472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330066.102477:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330066.102503:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef6e78400/0x8475908e9fd0f37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0f30 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.102531:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e78400/0x8475908e9fd0f37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0f30 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.102542:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef6e78400/0x8475908e9fd0f37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0f30 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.102565:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78400, rc 0) 00000100:00100000:1.0:1788330066.102621:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792313472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330066.102628:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788330066.102702:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792313472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330066.102719:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99edc765ac00/0x8475908e9fd0f30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f37 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330066.102729:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99edc765ac00/0x8475908e9fd0f30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0f37 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330066.102798:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792313600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330066.102825:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330066.103095:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10a5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788330066.103135:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792313600 00000100:00100000:0.0:1788330066.103141:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792313600 00000100:00100000:0.0:1788330066.103186:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788330066.103194:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792313600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330066.103417:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792313600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.103424:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788330066.110042:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792313600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330066.110282:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792313728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330066.110397:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330066.110453:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59db3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330066.110613:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792313728 00000100:00100000:0.0:1788330066.110623:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792313728 00000100:00100000:0.0:1788330066.110697:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788330066.110709:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792313728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330066.110887:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792313728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.110896:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788330066.111094:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792313728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330066.111571:0:10361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10361:1875199792313856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788330066.111764:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330066.111804:0:10361:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7263e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788330066.111870:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792313856 00000100:00100000:1.0:1788330066.111884:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792313856 00000100:00100000:1.0:1788330066.111931:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788330066.111940:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:10361:x1875199792313856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330066.112069:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:10361:x1875199792313856:12345-0@lo:502:llog_process_th.0 Request processed in 130us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330066.112077:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788330066.112283:0:10361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10361:1875199792313856:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788330066.112316:0:10361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330066.112328:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330066.112331:0:10361:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788330066.112341:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788330066.112371:0:10361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10361:1875199792313984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330066.112412:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330066.112447:0:10361:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10a5240 going to sleep for 11 seconds 00000100:00100000:3.0:1788330066.112509:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792313984 00000100:00100000:3.0:1788330066.112516:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792313984 00000100:00100000:3.0:1788330066.112566:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788330066.112576:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:10361:x1875199792313984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330066.112671:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:10361:x1875199792313984:12345-0@lo:502:llog_process_th.0 Request processed in 97us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330066.112678:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788330066.112755:0:10361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10361:1875199792313984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788330066.112774:0:10361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330066.112779:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330066.112781:0:10361:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788330066.112785:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788330066.113237:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1788330066.113272:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788330066.113285:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765ac00/0x8475908e9fd0f30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f37 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.113299:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99edc765ac00/0x8475908e9fd0f30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f37 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330066.113311:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788330066.113314:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99eee7570000 from 1 10000000:01000000:1.0:1788330066.113317:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788330066.113352:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd0f3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.113362:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd0f3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.113372:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd0f3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330066.113389:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792314112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788330066.113428:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.113452:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef408c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330066.113560:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792314112 00000100:00100000:0.0:1788330066.113567:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792314112 00000100:00100000:0.0:1788330066.113866:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788330066.113877:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792314112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330066.113890:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330066.113906:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef58c3000/0x8475908e9fd0f45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0f3e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.113935:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef58c3000/0x8475908e9fd0f45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0f3e expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.113946:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef58c3000/0x8475908e9fd0f45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0f3e expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.113958:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c3000, rc 0) 00000100:00100000:0.0:1788330066.114008:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792314112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.114015:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788330066.114132:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792314112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330066.114184:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd0f3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f45 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.114196:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd0f3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0f45 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330066.114264:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792314240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330066.114290:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.114308:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef408c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330066.114409:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792314240 00000100:00100000:0.0:1788330066.114414:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792314240 00000100:00100000:0.0:1788330066.114444:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788330066.114451:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792314240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330066.114706:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792314240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (415us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788330066.114714:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788330066.114775:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792314240:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788330066.114803:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788330066.114809:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd0f3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f45 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330066.114818:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd0f3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f45 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330066.145941:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330066.145985:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330066.146059:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766041728 00000100:00100000:0.0:1788330066.146081:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766041728 00000100:00100000:0.0:1788330066.146187:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00100000:0.0:1788330066.146199:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766041728:12345-192.168.202.50@tcp:400: 00000100:00100000:2.0:1788330066.146236:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766041984 00000100:00100000:2.0:1788330066.146243:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766041984 00000100:00100000:2.0:1788330066.146289:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:2.0:1788330066.146301:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766041984:12345-192.168.202.50@tcp:400: 00000100:00100000:0.0:1788330066.146326:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766041728:12345-192.168.202.50@tcp:400: Request processed in 128us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.146336:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00100000:2.0:1788330066.146344:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766041984:12345-192.168.202.50@tcp:400: Request processed in 46us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330066.146352:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00080000:3.0:1788330066.146886:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330066.146894:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330066.147877:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330066.147924:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330066.148137:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330066.148143:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766041856 00000100:00100000:2.0:1788330066.148180:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766041856 00000100:00100000:3.0:1788330066.148181:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766042112 00000100:00100000:3.0:1788330066.148186:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766042112 00000100:00100000:3.0:1788330066.148238:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:3.0:1788330066.148246:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766042112:12345-192.168.202.50@tcp:400: 00000100:00100000:3.0:1788330066.148302:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766042112:12345-192.168.202.50@tcp:400: Request processed in 58us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330066.148317:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:0.0:1788330066.148381:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766041600 00000100:00100000:0.0:1788330066.148385:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766041600 00000100:00100000:0.0:1788330066.148409:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 242 00000100:00100000:0.0:1788330066.148413:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+8:2410:x1875199766041600:12345-192.168.202.50@tcp:400: 00000100:00100000:0.0:1788330066.148436:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+8:2410:x1875199766041600:12345-192.168.202.50@tcp:400: Request processed in 24us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.148440:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 242 00000100:00100000:2.0:1788330066.148604:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 60 00000100:00100000:2.0:1788330066.148614:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766041856:12345-192.168.202.50@tcp:400: 00000100:00100000:2.0:1788330066.148649:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766041856:12345-192.168.202.50@tcp:400: Request processed in 38us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330066.148655:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 60 00000100:00080000:3.0:1788330066.153423:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788330066.153435:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330066.331596:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792314752:0@lo:400:kworker.0 00000100:00100000:2.0:1788330066.331615:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792314368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330066.331745:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330066.331778:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792314624:0@lo:400:kworker.0 00000100:00100000:2.0:1788330066.331838:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792314496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330066.331886:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330066.331899:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.331962:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792314624 00000100:00100000:0.0:1788330066.331965:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792315136:0@lo:400:kworker.0 00000100:00100000:2.0:1788330066.331974:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792315008:0@lo:400:kworker.0 00000100:00100000:1.0:1788330066.331976:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792314624 00000100:00100000:0.0:1788330066.332013:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330066.332031:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330066.332049:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792315648:0@lo:400:kworker.0 00000100:00100000:1.0:1788330066.332067:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792315136 00000100:00100000:2.0:1788330066.332071:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792315520:0@lo:400:kworker.0 00000100:00100000:1.0:1788330066.332074:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792315136 00000100:00100000:0.0:1788330066.332099:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330066.332134:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330066.332190:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792316160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330066.332200:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792316032:0@lo:400:kworker.0 00000100:00100000:0.0:1788330066.332229:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330066.332246:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330066.332307:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792314368 00000100:00100000:2.0:1788330066.332313:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792314368 00000100:00100000:2.0:1788330066.332343:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792314496 00000100:00100000:2.0:1788330066.332346:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792314496 00000100:00100000:2.0:1788330066.332366:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788330066.332377:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792314368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788330066.332417:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330066.332472:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792314368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330066.332480:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788330066.332502:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788330066.332509:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792314496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788330066.332519:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330066.332543:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792314496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330066.332709:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792315648 00000100:00100000:1.0:1788330066.332714:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792315648 00000100:00100000:1.0:1788330066.332739:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788330066.332747:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792314624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330066.332801:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792314624:12345-0@lo:400:kworker.0 Request processed in 55us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330066.332816:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788330066.332826:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788330066.332846:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788330066.332855:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792315136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330066.332856:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792315008 00000100:00100000:2.0:1788330066.332865:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792315008 00000100:00100000:1.0:1788330066.332900:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792315136:12345-0@lo:400:kworker.0 Request processed in 46us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330066.332903:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792316160 00000100:00100000:2.0:1788330066.332909:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792316160 00000100:00100000:1.0:1788330066.332910:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788330066.332927:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788330066.332932:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788330066.332939:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792315008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330066.332944:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792315648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330066.332987:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792315648:12345-0@lo:400:kworker.0 Request processed in 47us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330066.332994:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788330066.332999:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792315008:12345-0@lo:400:kworker.0 Request processed in 61us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330066.333016:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788330066.333028:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788330066.333034:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792316160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788330066.333060:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788330066.333406:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792315520 00000100:00100000:1.0:1788330066.333416:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792315520 00000100:00100000:0.0:1788330066.333417:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792314624:0@lo:400:kworker.0 00000100:00100000:0.0:1788330066.333460:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792315136:0@lo:400:kworker.0 00000100:00100000:1.0:1788330066.333463:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792316032 00000100:00100000:1.0:1788330066.333471:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792316032 00000100:00100000:0.0:1788330066.333482:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792315648:0@lo:400:kworker.0 00000100:00100000:1.0:1788330066.333505:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788330066.333520:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792315520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330066.333576:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788330066.333584:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792315520:12345-0@lo:400:kworker.0 Request processed in 68us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330066.333593:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788330066.333602:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792316032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330066.333699:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792316032:12345-0@lo:400:kworker.0 Request processed in 112us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.333708:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788330066.333755:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc9ed80 x1875199792314368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330066.333776:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792314880:0@lo:400:kworker.0 00000100:00100000:1.0:1788330066.333783:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792314368:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788330066.333815:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc730dc00 x1875199792314496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330066.333825:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.333852:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792314496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330066.333858:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792315392:0@lo:400:kworker.0 00000100:00100000:1.0:1788330066.333879:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792315008:0@lo:400:kworker.0 00000100:00100000:0.0:1788330066.333894:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788330066.333901:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc1aa00 x1875199792315520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330066.333914:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792315520:0@lo:400:kworker.0 00000100:00100000:0.0:1788330066.333926:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792315904:0@lo:400:kworker.0 00010000:00080000:1.0:1788330066.333933:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc1a680 x1875199792316032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330066.333945:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792316032:0@lo:400:kworker.0 00000100:00100000:0.0:1788330066.333954:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330066.334028:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792315392 00000100:00100000:0.0:1788330066.334034:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792314880 00000100:00100000:1.0:1788330066.334035:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792315392 00000100:00100000:0.0:1788330066.334045:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792314880 00000100:00100000:1.0:1788330066.334085:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792315904 00000100:00100000:0.0:1788330066.334092:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788330066.334094:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792315904 00000100:00100000:0.0:1788330066.334101:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792314880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330066.334133:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788330066.334141:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792314880:12345-0@lo:400:kworker.0 Request processed in 39us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.334180:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788330066.334183:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792315392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330066.334212:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792314880:0@lo:400:kworker.0 00000100:00100000:1.0:1788330066.334251:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792315392:12345-0@lo:400:kworker.0 Request processed in 105us (353us total) trans 0 rc 0/0 00010000:00080000:0.0:1788330066.334253:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc1a300 x1875199792315392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330066.334281:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788330066.334288:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792315392:0@lo:400:kworker.0 00000100:00100000:1.0:1788330066.334311:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788330066.334316:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788330066.334323:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330066.334331:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792315904:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788330066.334332:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330066.334400:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792315904:12345-0@lo:400:kworker.0 Request processed in 76us (442us total) trans 0 rc 0/0 00010000:00080000:0.0:1788330066.334409:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc18a80 x1875199792315904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330066.334411:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788330066.334441:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792315904:0@lo:400:kworker.0 00000100:00100000:3.0:1788330066.338845:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330066.338910:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792315264:0@lo:400:kworker.0 00000100:00100000:3.0:1788330066.338967:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330066.338995:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792315776:0@lo:400:kworker.0 00000100:00100000:3.0:1788330066.339029:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330066.339093:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792315264 00000100:00100000:3.0:1788330066.339103:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792315264 00000100:00100000:3.0:1788330066.339186:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792315776 00000100:00100000:3.0:1788330066.339190:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792315776 00000100:00100000:3.0:1788330066.339216:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788330066.339227:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792315264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330066.339293:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792315264:12345-0@lo:400:kworker.0 Request processed in 67us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330066.339300:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788330066.339320:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788330066.339327:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792315776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330066.339355:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792315776:12345-0@lo:400:kworker.0 Request processed in 28us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330066.339360:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788330066.339385:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788330066.339422:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc1b800 x1875199792315264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330066.339458:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792315264:0@lo:400:kworker.0 00010000:00080000:3.0:1788330066.339473:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc19180 x1875199792315776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330066.339482:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792315776:0@lo:400:kworker.0 00000100:00100000:0.0:1788330066.339837:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792314752 00000100:00100000:0.0:1788330066.339844:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792314752 00000100:00100000:0.0:1788330066.339886:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788330066.339894:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792314752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330066.339946:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792314752:12345-0@lo:400:kworker.0 Request processed in 54us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.339953:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788330066.341523:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792314752:0@lo:400:kworker.0 00000100:00100000:0.0:1788330066.344402:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792316160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330066.345371:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792316160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 11208us (12015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330066.345390:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788330066.531752:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330066.531887:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766042240 00000100:00100000:0.0:1788330066.531904:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766042240 00000100:00100000:0.0:1788330066.531979:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 243 00000100:00100000:0.0:1788330066.531995:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+8:6187:x1875199766042240:12345-192.168.202.50@tcp:101: 00010000:00010000:0.0:1788330066.532030:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330066.532053:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0f4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105d15 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.532090:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d15 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.532104:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d15 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330066.532116:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c3200, rc 0) 00000100:00100000:0.0:1788330066.532240:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+9:6187:x1875199766042240:12345-192.168.202.50@tcp:101: Request processed in 248us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.532264:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 243 00000100:00100000:2.0:1788330066.535454:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330066.536518:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766042368 00000100:00100000:1.0:1788330066.536561:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766042368 00000100:00100000:1.0:1788330066.536651:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 244 00000100:00100000:1.0:1788330066.536665:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+9:6187:x1875199766042368:12345-192.168.202.50@tcp:501: 00000100:00100000:1.0:1788330066.536892:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+9:6187:x1875199766042368:12345-192.168.202.50@tcp:501: Request processed in 229us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330066.536901:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 244 00000100:00100000:1.0:1788330066.549185:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330066.551057:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766042496 00000100:00100000:3.0:1788330066.551077:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766042496 00000100:00100000:3.0:1788330066.551217:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 245 00000100:00100000:3.0:1788330066.551229:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+9:6187:x1875199766042496:12345-192.168.202.50@tcp:503: 00000100:00100000:3.0:1788330066.551426:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+9:6187:x1875199766042496:12345-192.168.202.50@tcp:503: Request processed in 199us (2288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330066.551435:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 245 00000100:00100000:3.0:1788330066.575141:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330066.575260:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766042624 00000100:00100000:0.0:1788330066.575275:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766042624 00000100:00100000:0.0:1788330066.575350:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 246 00000100:00100000:0.0:1788330066.575430:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+9:6667:x1875199766042624:12345-192.168.202.50@tcp:502: 00000100:00100000:0.0:1788330066.575662:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+9:6667:x1875199766042624:12345-192.168.202.50@tcp:502: Request processed in 301us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330066.575673:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 246 00000100:00100000:2.0:1788330066.582384:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330066.582493:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766042752 00000100:00100000:1.0:1788330066.582513:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766042752 00000100:00100000:1.0:1788330066.582601:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 247 00000100:00100000:1.0:1788330066.582615:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+9:6667:x1875199766042752:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788330066.582846:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+9:6667:x1875199766042752:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 233us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330066.582856:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 247 00000100:00100000:1.0:1788330066.590388:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330066.590574:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766042880 00000100:00100000:3.0:1788330066.590599:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766042880 00000100:00100000:3.0:1788330066.590679:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 248 00000100:00100000:3.0:1788330066.590692:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+9:6187:x1875199766042880:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330066.590724:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330066.590751:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef59cb000/0x8475908e9fd0f53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105d1c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330066.590789:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef59cb000/0x8475908e9fd0f53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d1c expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330066.590824:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef59cb000/0x8475908e9fd0f53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d1c expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330066.590836:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cb000, rc 0) 00000100:00100000:3.0:1788330066.591113:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6187:x1875199766042880:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 Request processed in 422us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330066.591123:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 248 00000100:00100000:3.0:1788330066.594410:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330066.594535:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766043008 00000100:00100000:0.0:1788330066.594559:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766043008 00000100:00100000:0.0:1788330066.594643:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 249 00000100:00100000:0.0:1788330066.594657:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6187:x1875199766043008:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330066.594842:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6187:x1875199766043008:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 Request processed in 186us (445us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788330066.594852:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 249 00010000:00010000:3.0:1788330066.844745:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330067.868003:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792316288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330067.868080:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788330067.868794:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330067.868980:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792316416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330067.869023:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330067.873374:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792316288 00000100:00100000:1.0:1788330067.873396:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792316288 00000100:00100000:1.0:1788330067.873452:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792316416 00000100:00100000:1.0:1788330067.873457:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792316416 00000100:00100000:1.0:1788330067.873480:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788330067.873490:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792316288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788330067.873524:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330067.873660:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792316288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 171us (5579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330067.873669:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788330067.873689:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788330067.873825:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6da0380 x1875199792316288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330067.873850:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792316288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330067.873966:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792316416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330067.873992:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330067.874033:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792316416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 337us (5009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330067.874039:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788330067.874100:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc730ce00 x1875199792316416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330067.874114:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792316416:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1788330068.158935:0:10398:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff01dccf40 20000000:00000080:2.0:1788330068.158960:0:10398:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99eef58f4c00 uarg=0000000000000000 20000000:01000000:2.0:1788330068.159008:0:10398:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788330068.159014:0:10398:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788330068.159019:0:10398:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788330068.165414:0:10399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788330068.165779:0:10398:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788330068.169129:0:10398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788330068.169195:0:10398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788330068.169212:0:10398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788330068.169230:0:10398:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788330068.169270:0:10398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99eef6e79800/0x8475908e9fd0f5a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330068.169291:0:10398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef58c2c00/0x8475908e9fd0bf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0bef expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330068.169299:0:10398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99ef02064c00/0x8475908e9fd0c04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0bfd expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330068.169305:0:10398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd0c58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0c51 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330068.169312:0:10398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef58c3a00/0x8475908e9fd0d7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0d77 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330068.169323:0:10398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef59cbe00/0x8475908e9fd0e96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105cdd expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330068.169330:0:10398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99eef6e79800/0x8475908e9fd0f5a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330068.169382:0:10398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef59cbe00/0x8475908e9fd0e96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105cdd expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330068.169421:0:10398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eef59cbe00/0x8475908e9fd0e96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105cdd expref: 9 pid: 6517 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330068.169440:0:10398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1875199792316544:192.168.202.50@tcp:104: 00010000:00010000:1.0:1788330068.169575:0:10398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef58c3a00/0x8475908e9fd0d7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0d77 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330068.169585:0:10398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eef58c3a00/0x8475908e9fd0d7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0d77 expref: 23 pid: 6516 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330068.169594:0:10398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1875199792316672:0@lo:104: 00000100:00100000:1.0:1788330068.169642:0:10398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788330068.169684:0:10398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd0c58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0c51 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330068.169693:0:10398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd0c58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0c51 expref: 23 pid: 6516 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330068.169701:0:10398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1875199792316800:0@lo:104: 00000100:00100000:1.0:1788330068.169724:0:10398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788330068.169746:0:10398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99ef02064c00/0x8475908e9fd0c04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0bfd expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330068.169753:0:10398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99ef02064c00/0x8475908e9fd0c04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0bfd expref: 23 pid: 6516 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330068.169762:0:10398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1875199792316928:0@lo:104: 00010000:00010000:1.0:1788330068.169786:0:10398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef58c2c00/0x8475908e9fd0bf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0bef expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330068.169801:0:10398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eef58c2c00/0x8475908e9fd0bf6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0bef expref: 23 pid: 6517 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330068.169844:0:10398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1875199792317056:0@lo:104: 00000100:00100000:1.0:1788330068.169865:0:10398:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee76e7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788330068.170139:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788330068.170183:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330068.170196:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330068.170205:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792316672 00000100:00100000:3.0:1788330068.170212:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792316672 00000100:00100000:3.0:1788330068.170252:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792316800 00000100:00100000:3.0:1788330068.170266:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792316800 00000100:00100000:3.0:1788330068.170277:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792316928 00000100:00100000:3.0:1788330068.170280:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792316928 00000100:00100000:3.0:1788330068.170288:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792317056 00000100:00100000:3.0:1788330068.170290:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792317056 00000100:00100000:3.0:1788330068.170303:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788330068.170311:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+6:10398:x1875199792316672:12345-0@lo:104: 00010000:00010000:3.0:1788330068.170325:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0d77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0d7e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330068.170396:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788330068.170403:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+6:10398:x1875199792316672:12345-0@lo:104: Request processed in 92us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330068.170411:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788330068.170431:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788330068.170436:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+5:10398:x1875199792316800:12345-0@lo:104: 00010000:00010000:3.0:1788330068.170444:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef58c2600/0x8475908e9fd0c51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0c58 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330068.170477:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788330068.170482:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+5:10398:x1875199792316800:12345-0@lo:104: Request processed in 46us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330068.170487:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788330068.170516:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788330068.170522:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:10398:x1875199792316928:12345-0@lo:104: 00010000:00010000:3.0:1788330068.170552:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd0bfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0c04 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330068.170585:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788330068.170590:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:10398:x1875199792316928:12345-0@lo:104: Request processed in 69us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330068.170596:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788330068.170608:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788330068.170614:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:10398:x1875199792317056:12345-0@lo:104: 00010000:00010000:3.0:1788330068.170621:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0bef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0bf6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330068.170653:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788330068.170658:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:10398:x1875199792317056:12345-0@lo:104: Request processed in 45us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330068.170664:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1788330068.170682:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788330068.170687:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0d77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0d7e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330068.170694:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c2800 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330068.170699:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0d77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0d7e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330068.170707:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0d7e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330068.170714:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0d7e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330068.170721:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788330068.170752:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0d77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0d7e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330068.170759:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330068.170784:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0d77 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0d7e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330068.170790:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0d77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0d7e expref: -99 pid: 9516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330068.170813:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788330068.170815:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef58c2600/0x8475908e9fd0c51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0c58 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330068.170821:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c2600 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330068.170823:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2600/0x8475908e9fd0c51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0c58 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330068.170829:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef58c2600/0x8475908e9fd0c51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0c58 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330068.170834:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2600/0x8475908e9fd0c51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0c58 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330068.170839:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788330068.170852:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef58c2600/0x8475908e9fd0c51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0c58 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330068.170854:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1788330068.170858:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330068.170863:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2600/0x8475908e9fd0c51 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0c58 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330068.170867:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792317312:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330068.170869:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef58c2600/0x8475908e9fd0c51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0c58 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330068.170877:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330068.170880:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd0bfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0c04 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330068.170894:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147b800 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330068.170897:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd0bfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0c04 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330068.170899:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788330068.170905:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd0bfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0c04 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330068.170910:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd0bfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0c04 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330068.170915:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788330068.170927:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd0bfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0c04 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330068.170928:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792317184:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330068.170933:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788330068.170946:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788330068.170948:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd0bfd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0c04 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330068.170955:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd0bfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0c04 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330068.170964:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330068.170967:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0bef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0bf6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330068.170973:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c2e00 already unused, calling callback (ffffffffc14efc20) 00000100:00100000:0.0:1788330068.170974:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792317312 10000000:00010000:3.0:1788330068.170976:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0bef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0bf6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330068.170978:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792317312 00010000:00010000:3.0:1788330068.170992:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0bf6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330068.170999:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0bef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0bf6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.171000:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd0c58 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0c51 expref: 24 pid: 6516 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330068.171005:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788330068.171018:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0bef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0bf6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330068.171019:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792317184 00000100:00100000:0.0:1788330068.171022:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792317184 00010000:00010000:3.0:1788330068.171024:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330068.171030:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0bef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0bf6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.171031:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef58c3a00/0x8475908e9fd0d7e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0d77 expref: 25 pid: 6516 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330068.171037:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0bef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0bf6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330068.171048:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1788330068.171050:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330068.171051:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330068.171053:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330068.171054:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+25:3647:x1875199792317312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330068.171060:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330068.171063:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330068.171064:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330068.171068:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd0c58 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0c51 expref: 25 pid: 6516 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.171077:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd0c58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0c51 expref: 25 pid: 6516 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330068.171079:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788330068.171085:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+25:3647:x1875199792317184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330068.171092:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330068.171093:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330068.171097:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef58c3a00/0x8475908e9fd0d7e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0d77 expref: 25 pid: 6516 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330068.171105:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef58c3a00/0x8475908e9fd0d7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0d77 expref: 25 pid: 6516 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330068.171117:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+25:3647:x1875199792317312:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (218us total) trans 0 rc 0/0 00010000:00010000:3.0:1788330068.171120:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330068.171122:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788330068.171140:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792317184:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330068.171147:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788330068.171165:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792317440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330068.171189:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330068.171221:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330068.171227:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792317568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330068.171248:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330068.171276:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792317440 00000100:00100000:0.0:1788330068.171280:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792317440 00010000:00010000:0.0:1788330068.171294:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99ef02064c00/0x8475908e9fd0c04 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0bfd expref: 24 pid: 6516 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330068.171306:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792317568 00000100:00100000:0.0:1788330068.171309:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792317568 00010000:00010000:0.0:1788330068.171317:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef58c2c00/0x8475908e9fd0bf6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0bef expref: 25 pid: 6517 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330068.171327:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788330068.171332:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+25:3648:x1875199792317440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330068.171339:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330068.171343:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99ef02064c00/0x8475908e9fd0c04 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0bfd expref: 25 pid: 6516 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.171349:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99ef02064c00/0x8475908e9fd0c04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0bfd expref: 25 pid: 6516 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.171358:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330068.171385:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+25:3648:x1875199792317440:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330068.171391:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788330068.171403:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788330068.171409:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec986d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3648:x1875199792317568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330068.171422:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330068.171427:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef58c2c00/0x8475908e9fd0bf6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0bef expref: 24 pid: 6517 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.171434:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef58c2c00/0x8475908e9fd0bf6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0bef expref: 24 pid: 6517 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.171444:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330068.171465:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec986d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3648:x1875199792317568:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330068.171471:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1788330068.171550:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c3a00/0x8475908e9fd0d7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0d77 expref: 23 pid: 6516 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330068.171562:0:10398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1875199792316672:0@lo:104: 00000100:00100000:0.0:1788330068.174107:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792317568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330068.174132:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792317440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330068.174207:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792317312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330068.174219:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792317184:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330068.175315:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd0c58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0c51 expref: 22 pid: 6516 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330068.175335:0:10398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1875199792316800:0@lo:104: 00010000:00010000:1.0:1788330068.175349:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ef02064c00/0x8475908e9fd0c04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0bfd expref: 21 pid: 6516 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330068.175363:0:10398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1875199792316928:0@lo:104: 00010000:00010000:1.0:1788330068.175374:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c2c00/0x8475908e9fd0bf6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0bef expref: 20 pid: 6517 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330068.175383:0:10398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1875199792317056:0@lo:104: 00000100:00100000:3.0:1788330068.178845:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330068.178869:0:10398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1875199792316544:192.168.202.50@tcp:104: 00010000:00010000:1.0:1788330068.178911:0:10398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99eef6e79800/0x8475908e9fd0f5a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330068.178980:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766043136 00000100:00100000:0.0:1788330068.178988:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766043136 00010000:00010000:0.0:1788330068.179030:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef59cbe00/0x8475908e9fd0e96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105cdd expref: 10 pid: 6517 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330068.179078:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00100000:0.0:1788330068.179090:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2412:x1875199766043136:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330068.179109:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330068.179116:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef59cbe00/0x8475908e9fd0e96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105cdd expref: 10 pid: 6517 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.179192:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef59cbe00/0x8475908e9fd0e96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105cdd expref: 10 pid: 6517 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.179211:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef59cbe00/0x8475908e9fd0e96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105cdd expref: 10 pid: 6517 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.179228:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99eef6e79800/0x8475908e9fd0f5a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.179236:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e79800/0x8475908e9fd0f5a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.179253:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eef6e79800/0x8475908e9fd0f5a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.179261:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eef6e79800/0x8475908e9fd0f5a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.179269:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99eef6e79800/0x8475908e9fd0f5a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.179275:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99eef6e79800/0x8475908e9fd0f5a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.179281:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330068.179285:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99eef6e79800/0x8475908e9fd0f5a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.179293:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99eef6e79800/0x8475908e9fd0f5a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.179324:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99eef6e79800/0x8475908e9fd0f5a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.179336:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788330068.179339:0:10398:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99eef6e79800/0x8475908e9fd0f5a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330068.179355:0:10398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99eef6e79800/0x8475908e9fd0f5a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330068.179360:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef6e79800/0x8475908e9fd0f5a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330068.179389:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa3490c8-da14-415b-81e3-af4ba0c476db+9:2412:x1875199766043136:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 300us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330068.179397:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 39 00010000:00010000:3.0:1788330068.894982:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330068.895409:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792317696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330068.895487:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330068.895576:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792317696 00000100:00100000:3.0:1788330068.895586:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792317696 00000100:00100000:3.0:1788330068.895642:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788330068.895653:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792317696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788330068.895697:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788330068.895766:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792317696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330068.895774:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788330068.895810:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792317696:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788330069.929820:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788330070.107245:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788330070.107256:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eef6de3800 from 4 10000000:01000000:1.0:1788330070.107262:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788330070.107315:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd0f61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330070.107328:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd0f61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330070.107340:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd0f61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330070.107368:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792317824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788330070.107443:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330070.107495:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59db600 going to sleep for 11 seconds 00000100:00100000:1.0:1788330070.107533:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792317824 00000100:00100000:1.0:1788330070.107540:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792317824 00000100:00100000:1.0:1788330070.107593:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788330070.107603:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792317824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330070.107618:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330070.107631:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef6e79e00/0x8475908e9fd0f68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0f61 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330070.107668:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e79e00/0x8475908e9fd0f68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0f61 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330070.107679:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef6e79e00/0x8475908e9fd0f68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0f61 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330070.107689:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79e00, rc 0) 00000100:00100000:1.0:1788330070.107729:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792317824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330070.107736:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788330070.107785:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792317824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330070.107799:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd0f61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f68 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330070.107808:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd0f61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0f68 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330070.107865:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792317952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330070.107891:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330070.107906:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59db600 going to sleep for 11 seconds 00000100:00100000:1.0:1788330070.107917:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792317952 00000100:00100000:1.0:1788330070.107921:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792317952 00000100:00100000:1.0:1788330070.107942:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788330070.107949:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792317952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330070.108061:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792317952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330070.108075:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788330070.108107:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792317952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330070.108136:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792318080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330070.108205:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330070.108224:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59db600 going to sleep for 11 seconds 00000100:00100000:1.0:1788330070.108235:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792318080 00000100:00100000:1.0:1788330070.108238:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792318080 00000100:00100000:1.0:1788330070.108265:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788330070.108270:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec2d19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792318080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330070.108348:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec2d19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792318080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330070.108354:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788330070.108398:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792318080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330070.109851:0:10465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10465:1875199792318208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330070.109917:0:10465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330070.109961:0:10465:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76ae3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330070.110664:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792318208 00000100:00100000:1.0:1788330070.110682:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792318208 00000100:00100000:1.0:1788330070.110740:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788330070.110749:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec2d19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:10465:x1875199792318208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330070.110882:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec2d19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:10465:x1875199792318208:12345-0@lo:502:llog_process_th.0 Request processed in 133us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330070.110889:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788330070.110984:0:10465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10465:1875199792318208:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788330070.111013:0:10465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330070.111023:0:10465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330070.111025:0:10465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788330070.111031:0:10465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99eef6de3800 00000020:00000080:3.0:1788330070.111034:0:10465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788330070.111119:0:10465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10465:1875199792318336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330070.111179:0:10465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330070.111202:0:10465:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76ae3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330070.116207:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792318336 00000100:00100000:1.0:1788330070.116225:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792318336 00000100:00100000:1.0:1788330070.116290:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788330070.116300:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:10465:x1875199792318336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330070.116500:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:10465:x1875199792318336:12345-0@lo:502:llog_process_th.0 Request processed in 201us (5320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330070.119770:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788330070.127050:0:10465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10465:1875199792318336:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788330070.127109:0:10465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330070.127121:0:10465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330070.127123:0:10465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788330070.127128:0:10465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788330070.128650:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788330070.128759:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788330070.128771:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd0f61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f68 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330070.128784:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd0f61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f68 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330070.130667:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788330070.130745:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eefe782800 from 4 10000000:01000000:3.0:1788330070.130751:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788330070.130795:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cb800/0x8475908e9fd0f6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330070.130805:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef59cb800/0x8475908e9fd0f6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330070.130815:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef59cb800/0x8475908e9fd0f6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330070.130840:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792318464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788330070.130915:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330070.130962:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76ae3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330070.131764:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792318464 00000100:00100000:2.0:1788330070.131774:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792318464 00000100:00100000:2.0:1788330070.131831:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788330070.131841:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792318464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330070.131863:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330070.131877:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99edc765b400/0x8475908e9fd0f76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0f6f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330070.131902:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99edc765b400/0x8475908e9fd0f76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0f6f expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330070.131912:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99edc765b400/0x8475908e9fd0f76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0f6f expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330070.131922:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99edc765b400, rc 0) 00000100:00100000:2.0:1788330070.131976:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792318464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330070.131983:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788330070.132110:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792318464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330070.132126:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef59cb800/0x8475908e9fd0f6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f76 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330070.132137:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef59cb800/0x8475908e9fd0f6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0f76 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330070.132213:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792318592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330070.132242:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330070.132277:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76ae3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330070.132291:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792318592 00000100:00100000:3.0:1788330070.132294:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792318592 00000100:00100000:3.0:1788330070.132318:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788330070.132324:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef40a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792318592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330070.132446:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef40a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792318592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330070.132453:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788330070.132483:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792318592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330070.132509:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792318720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330070.132638:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330070.132650:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76ae3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330070.132772:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792318720 00000100:00100000:2.0:1788330070.132776:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792318720 00000100:00100000:2.0:1788330070.132803:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788330070.132809:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792318720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330070.132888:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792318720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330070.132895:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788330070.132940:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792318720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330070.144482:0:10469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10469:1875199792318848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330070.144649:0:10469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330070.144751:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792318848 00000100:00100000:3.0:1788330070.144759:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792318848 00000100:00100000:3.0:1788330070.144800:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788330070.144809:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:10469:x1875199792318848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330070.144918:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:10469:x1875199792318848:12345-0@lo:502:llog_process_th.0 Request processed in 109us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330070.144925:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788330070.144976:0:10469:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76aecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330070.144995:0:10469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10469:1875199792318848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788330070.145020:0:10469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330070.145029:0:10469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330070.145036:0:10469:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788330070.145042:0:10469:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99eefe782800 00000020:00000080:3.0:1788330070.145045:0:10469:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788330070.145126:0:10469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10469:1875199792318976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330070.145194:0:10469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330070.145213:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792318976 00000100:00100000:3.0:1788330070.145216:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792318976 00000100:00100000:3.0:1788330070.145237:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788330070.145242:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00beb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:10469:x1875199792318976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330070.145300:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00beb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:10469:x1875199792318976:12345-0@lo:502:llog_process_th.0 Request processed in 56us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330070.145307:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788330070.145337:0:10469:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76aecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330070.145348:0:10469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10469:1875199792318976:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788330070.145365:0:10469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330070.145369:0:10469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330070.145370:0:10469:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788330070.145374:0:10469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788330070.145432:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788330070.145451:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788330070.145461:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cb800/0x8475908e9fd0f6f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f76 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330070.145471:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef59cb800/0x8475908e9fd0f6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f76 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330070.145481:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788330070.145484:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eef59c6800 from 4 10000000:01000000:3.0:1788330070.145487:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788330070.145528:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd0f7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330070.145536:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd0f7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330070.145751:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd0f7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330070.145768:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792319104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788330070.145797:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330070.145815:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76aecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330070.145829:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792319104 00000100:00100000:3.0:1788330070.145833:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792319104 00000100:00100000:3.0:1788330070.145858:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788330070.145864:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00bea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792319104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330070.145873:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330070.145886:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd0f84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0f7d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330070.145908:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd0f84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0f7d expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330070.145917:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd0f84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0f7d expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330070.145926:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cbc00, rc 0) 00000100:00100000:3.0:1788330070.145955:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00bea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792319104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330070.145961:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788330070.146000:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792319104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330070.146013:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd0f7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f84 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330070.146021:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd0f7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0f84 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330070.146065:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792319232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330070.146087:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330070.146098:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76aecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330070.146107:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792319232 00000100:00100000:3.0:1788330070.146110:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792319232 00000100:00100000:3.0:1788330070.146128:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788330070.146133:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00bea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792319232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330070.146229:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00bea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792319232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330070.146236:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788330070.146260:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792319232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330070.146280:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792319360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330070.146307:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330070.146323:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76aecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330070.146332:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792319360 00000100:00100000:3.0:1788330070.146335:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792319360 00000100:00100000:3.0:1788330070.146353:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788330070.146358:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792319360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330070.146422:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792319360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330070.146435:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788330070.146469:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792319360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330070.154564:0:10470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10470:1875199792319488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330070.154663:0:10470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330070.154724:0:10470:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10889c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330070.154873:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792319488 00000100:00100000:1.0:1788330070.154881:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792319488 00000100:00100000:1.0:1788330070.154932:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788330070.154941:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:10470:x1875199792319488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330070.155057:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:10470:x1875199792319488:12345-0@lo:502:llog_process_th.0 Request processed in 115us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330070.155064:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788330070.156495:0:10470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10470:1875199792319488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788330070.156564:0:10470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330070.156575:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330070.156578:0:10470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788330070.156586:0:10470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99eef59c6800 00000020:00000080:2.0:1788330070.156589:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788330070.156795:0:10470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10470:1875199792319616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330070.156864:0:10470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330070.156907:0:10470:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10889c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330070.157246:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792319616 00000100:00100000:2.0:1788330070.157252:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792319616 00000100:00100000:2.0:1788330070.157299:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788330070.157307:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:10470:x1875199792319616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330070.157423:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:10470:x1875199792319616:12345-0@lo:502:llog_process_th.0 Request processed in 115us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330070.157430:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788330070.157476:0:10470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10470:1875199792319616:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788330070.157508:0:10470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330070.157521:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330070.157523:0:10470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788330070.157527:0:10470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788330070.159735:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788330070.159773:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788330070.159785:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd0f7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f84 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330070.159799:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd0f7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f84 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330070.159814:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788330070.159817:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eec865b000 from 4 10000000:01000000:0.0:1788330070.159821:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788330070.159869:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0f8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330070.159877:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0f8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330070.159888:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0f8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330070.159931:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792319744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788330070.160008:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330070.160059:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec98de180 going to sleep for 11 seconds 00000100:00100000:2.0:1788330070.160210:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792319744 00000100:00100000:2.0:1788330070.160219:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792319744 00000100:00100000:2.0:1788330070.160268:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788330070.160278:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792319744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330070.160291:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330070.160301:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99edc765bc00/0x8475908e9fd0f92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0f8b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330070.160333:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99edc765bc00/0x8475908e9fd0f92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0f8b expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330070.160344:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99edc765bc00/0x8475908e9fd0f92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0f8b expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330070.160353:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99edc765bc00, rc 0) 00000100:00100000:2.0:1788330070.160394:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792319744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330070.160401:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788330070.160443:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792319744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330070.160457:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0f8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f92 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330070.160465:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0f8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0f92 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330070.160532:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792319872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330070.160569:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330070.160589:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc1088a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330070.160600:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792319872 00000100:00100000:2.0:1788330070.160603:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792319872 00000100:00100000:2.0:1788330070.160625:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788330070.160631:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792319872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330070.160853:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792319872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330070.160872:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788330070.160905:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792319872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330070.160932:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792320000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330070.160969:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330070.160983:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc1088a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330070.160993:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792320000 00000100:00100000:2.0:1788330070.160996:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792320000 00000100:00100000:2.0:1788330070.161014:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788330070.161020:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792320000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330070.161091:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792320000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330070.161097:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788330070.161135:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792320000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330070.164486:0:10472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10472:1875199792320128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788330070.164598:0:10472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330070.164646:0:10472:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec98de180 going to sleep for 11 seconds 00000100:00100000:2.0:1788330070.165253:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792320128 00000100:00100000:2.0:1788330070.165265:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792320128 00000100:00100000:2.0:1788330070.165320:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788330070.165331:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:10472:x1875199792320128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330070.165467:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:10472:x1875199792320128:12345-0@lo:502:llog_process_th.0 Request processed in 137us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330070.165474:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788330070.165668:0:10472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10472:1875199792320128:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788330070.165766:0:10472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788330070.165776:0:10472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330070.165779:0:10472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788330070.165786:0:10472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99eec865b000 00000020:00000080:0.0:1788330070.165789:0:10472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788330070.165876:0:10472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10472:1875199792320256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788330070.165912:0:10472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330070.166328:0:10472:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef4118480 going to sleep for 11 seconds 00000100:00100000:3.0:1788330070.167992:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792320256 00000100:00100000:3.0:1788330070.168004:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792320256 00000100:00100000:3.0:1788330070.168059:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788330070.168069:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:10472:x1875199792320256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330070.168231:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:10472:x1875199792320256:12345-0@lo:502:llog_process_th.0 Request processed in 162us (2317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330070.168239:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788330070.168355:0:10472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:10472:1875199792320256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788330070.168385:0:10472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788330070.168392:0:10472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330070.168395:0:10472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788330070.168400:0:10472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788330070.168629:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788330070.168652:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788330070.168663:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0f8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f92 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330070.168742:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0f8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f92 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330070.195031:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330070.195243:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766043264 00000100:00100000:3.0:1788330070.195253:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766043264 00000100:00100000:3.0:1788330070.195313:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 270 00000100:00100000:3.0:1788330070.195323:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+9:6187:x1875199766043264:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330070.195341:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330070.195359:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef59cb400/0x8475908e9fd0f99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105d23 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330070.195392:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef59cb400/0x8475908e9fd0f99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d23 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330070.195415:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef59cb400/0x8475908e9fd0f99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d23 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330070.195425:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cb400, rc 0) 00000100:00100000:3.0:1788330070.195482:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6187:x1875199766043264:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 Request processed in 160us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330070.195489:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 270 00000100:00100000:1.0:1788330070.213631:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330070.215271:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766043392 00000100:00100000:0.0:1788330070.215285:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766043392 00000100:00100000:0.0:1788330070.215361:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 271 00000100:00100000:0.0:1788330070.215371:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6187:x1875199766043392:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330070.215561:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6187:x1875199766043392:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 Request processed in 190us (1941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330070.215588:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 271 00000100:00100000:2.0:1788330070.223604:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330070.223820:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766043520 00000100:00100000:3.0:1788330070.223831:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766043520 00000100:00100000:3.0:1788330070.223892:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 272 00000100:00100000:3.0:1788330070.223903:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6187:x1875199766043520:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330070.224059:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6187:x1875199766043520:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 Request processed in 157us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330070.224067:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 272 00000100:00100000:2.0:1788330070.231242:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330070.231295:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766043648 00000100:00100000:1.0:1788330070.231306:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766043648 00000100:00100000:1.0:1788330070.231370:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 273 00000100:00100000:1.0:1788330070.231383:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6730:x1875199766043648:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788330070.231567:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6730:x1875199766043648:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 186us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330070.231575:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 273 00000100:00100000:1.0:1788330070.237943:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330070.238054:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766043776 00000100:00100000:0.0:1788330070.238064:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766043776 00000100:00100000:0.0:1788330070.238124:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 274 00000100:00100000:0.0:1788330070.238136:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6730:x1875199766043776:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788330070.238431:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+10:6730:x1875199766043776:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 297us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330070.238440:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 274 00010000:00010000:2.0:1788330070.946144:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330071.270310:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330071.270358:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330071.270395:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330071.270412:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330071.270458:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330071.270572:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766044416 00000100:00100000:0.0:1788330071.270584:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766044416 00000100:00100000:0.0:1788330071.270656:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766044288 00000100:00100000:0.0:1788330071.270660:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766044288 00000100:00100000:0.0:1788330071.270682:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:0.0:1788330071.270692:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766044416:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330071.270763:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766044416:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 73us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.270770:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:0.0:1788330071.270787:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:0.0:1788330071.270793:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766044288:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330071.270815:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766044288:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 23us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.270821:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:1.0:1788330071.270901:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766044160 00000100:00100000:1.0:1788330071.270907:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766044160 00000100:00100000:1.0:1788330071.270953:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766044032 00000100:00100000:1.0:1788330071.270957:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766044032 00000100:00100000:1.0:1788330071.270979:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00100000:1.0:1788330071.270987:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766044160:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330071.271016:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766044160:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 31us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330071.271037:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00100000:1.0:1788330071.271051:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 68 00000100:00100000:1.0:1788330071.271058:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2412:x1875199766044032:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330071.271084:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2412:x1875199766044032:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 26us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330071.271089:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 68 00000100:00080000:2.0:1788330071.271332:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788330071.271337:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788330071.271339:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788330071.271341:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330071.271396:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766043904 00000100:00100000:3.0:1788330071.271402:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766043904 00000100:00100000:3.0:1788330071.271509:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 275 00000100:00100000:3.0:1788330071.271518:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2412:x1875199766043904:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330071.271557:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2412:x1875199766043904:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 41us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330071.271564:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 275 00000100:00100000:0.0:1788330071.451737:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792320384:0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.451844:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330071.451903:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792320896:0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.451931:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330071.451953:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792321408:0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.451974:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330071.451989:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792321920:0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.452008:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330071.452031:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788330071.452037:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792320768:0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.452060:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330071.452075:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792321280:0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.452094:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330071.452108:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792321792:0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.452126:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330071.452174:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792320384 00000100:00100000:0.0:1788330071.452181:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792320384 00000100:00100000:0.0:1788330071.452227:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788330071.452236:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792320384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.452283:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792320384:12345-0@lo:400:kworker.0 Request processed in 48us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.452290:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788330071.452331:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792321408 00000100:00100000:0.0:1788330071.452334:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792321408 00000100:00100000:0.0:1788330071.452364:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792321920 00000100:00100000:0.0:1788330071.452367:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792321920 00000100:00100000:0.0:1788330071.452379:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792321280 00000100:00100000:0.0:1788330071.452381:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792321280 00000100:00100000:0.0:1788330071.452392:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792321792 00000100:00100000:0.0:1788330071.452402:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792321792 00000100:00100000:0.0:1788330071.452425:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788330071.452430:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792321408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.452461:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792321408:12345-0@lo:400:kworker.0 Request processed in 31us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.452468:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788330071.452480:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788330071.452485:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792321920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.452522:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792321920:12345-0@lo:400:kworker.0 Request processed in 37us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.452528:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788330071.452539:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788330071.452544:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792321280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.452567:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792321280:12345-0@lo:400:kworker.0 Request processed in 23us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.452572:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788330071.452581:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788330071.452586:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792321792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.452611:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792321792:12345-0@lo:400:kworker.0 Request processed in 24us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.452616:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788330071.452637:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330071.452641:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788330071.452674:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc1a300 x1875199792321280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330071.452688:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792321280:0@lo:400:kworker.0 00010000:00080000:0.0:1788330071.452710:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef59df100 x1875199792321792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330071.452718:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792321792:0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.452727:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792320384:0@lo:400:kworker.0 00010000:00080000:0.0:1788330071.452736:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc1a680 x1875199792321408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330071.452743:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792321408:0@lo:400:kworker.0 00010000:00080000:0.0:1788330071.452753:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef59dc000 x1875199792321920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330071.452760:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792321920:0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.452819:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792320640:0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.452846:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330071.452869:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792321152:0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.452889:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330071.452903:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792321664:0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.452922:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330071.452941:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788330071.452947:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792320512:0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.452967:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330071.452983:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792321024:0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.453004:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330071.453014:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792321536:0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.453043:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330071.453068:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792320896 00000100:00100000:0.0:1788330071.453072:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792320896 00000100:00100000:0.0:1788330071.453101:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792320640 00000100:00100000:0.0:1788330071.453104:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792320640 00000100:00100000:0.0:1788330071.453116:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788330071.453122:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792320896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.453185:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792320896:12345-0@lo:400:kworker.0 Request processed in 63us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.453191:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788330071.453204:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788330071.453210:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792320640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.453241:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792320640:12345-0@lo:400:kworker.0 Request processed in 32us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.453246:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788330071.453263:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792320768 00000100:00100000:0.0:1788330071.453266:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792320768 00000100:00100000:0.0:1788330071.453282:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792321152 00000100:00100000:0.0:1788330071.453285:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792321152 00000100:00100000:0.0:1788330071.453302:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792321664 00000100:00100000:0.0:1788330071.453304:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792321664 00000100:00100000:0.0:1788330071.453315:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792320512 00000100:00100000:0.0:1788330071.453317:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792320512 00000100:00100000:0.0:1788330071.453326:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792321024 00000100:00100000:0.0:1788330071.453328:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792321024 00000100:00100000:0.0:1788330071.453338:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792321536 00000100:00100000:0.0:1788330071.453340:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792321536 00000100:00100000:0.0:1788330071.453353:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788330071.453357:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792320768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.453396:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792320768:12345-0@lo:400:kworker.0 Request processed in 38us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.453402:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788330071.453415:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788330071.453421:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792321152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.453448:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792321152:12345-0@lo:400:kworker.0 Request processed in 28us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.453454:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788330071.453465:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788330071.453471:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875199792321664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.453494:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875199792321664:12345-0@lo:400:kworker.0 Request processed in 24us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.453512:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788330071.453523:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788330071.453529:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792320512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.453556:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792320512:12345-0@lo:400:kworker.0 Request processed in 28us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.453562:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788330071.453574:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788330071.453580:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792321024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.453605:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792321024:12345-0@lo:400:kworker.0 Request processed in 26us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.453610:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788330071.453620:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788330071.453625:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792321536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.453659:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792321536:12345-0@lo:400:kworker.0 Request processed in 34us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.453665:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788330071.453680:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330071.453683:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788330071.453702:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792320512:0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.453711:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792321024:0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.453718:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792321536:0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.453727:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792320640:0@lo:400:kworker.0 00010000:00080000:0.0:1788330071.453736:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc18a80 x1875199792321152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330071.453745:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792321152:0@lo:400:kworker.0 00010000:00080000:0.0:1788330071.453753:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc1ad80 x1875199792321664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330071.453760:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792321664:0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.453788:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792320768:0@lo:400:kworker.0 00000100:00100000:0.0:1788330071.453798:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792320896:0@lo:400:kworker.0 00000100:00100000:1.0:1788330071.455648:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792322048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330071.455712:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330071.455753:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788330071.455759:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792322176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330071.455797:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330071.455832:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792322176 00000100:00100000:1.0:1788330071.455837:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792322176 00000100:00100000:1.0:1788330071.455889:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788330071.455898:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792322176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330071.455925:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330071.455964:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792322176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330071.455971:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788330071.455992:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792322048 00000100:00100000:1.0:1788330071.455996:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792322048 00000100:00100000:1.0:1788330071.456018:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788330071.456026:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792322048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788330071.456049:0:7831:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788330071.456078:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792322048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330071.456101:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1788330071.456137:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6da3480 x1875199792322176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330071.456176:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792322176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330071.456190:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792322048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330071.459357:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788330071.459382:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792322304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330071.459453:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330071.461762:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792322304 00000100:00100000:1.0:1788330071.461786:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792322304 00000100:00100000:1.0:1788330071.461859:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788330071.461870:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792322304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788330071.461897:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330071.461977:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792322304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (2522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330071.461985:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788330071.462539:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc19880 x1875199792322304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330071.462588:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792322304:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788330071.967661:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330072.987350:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330072.987939:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330072.987962:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792322432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330072.988037:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330072.988135:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792322432 00000100:00100000:0.0:1788330072.988143:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792322432 00000100:00100000:0.0:1788330072.988206:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788330072.988215:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792322432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788330072.988246:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330072.988293:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792322432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330072.988301:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788330072.988355:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc19880 x1875199792322432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330072.988372:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792322432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330072.995913:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788330073.007964:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792322560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788330073.008062:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330073.008300:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792322560 00000100:00100000:1.0:1788330073.008321:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792322560 00000100:00100000:1.0:1788330073.008391:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788330073.008405:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792322560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788330073.008436:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330073.008503:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792322560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330073.008511:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788330073.008957:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788330073.009001:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6da0380 x1875199792322560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330073.009023:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792322560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788330074.014511:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792322688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788330074.014625:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330074.014725:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330074.014740:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792322688 00000100:00100000:2.0:1788330074.014750:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792322688 00000100:00100000:2.0:1788330074.014811:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788330074.014821:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792322688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788330074.014866:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788330074.014920:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792322688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330074.014928:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788330074.015003:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792322688:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788330075.035481:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788330075.831504:0:10698:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1788330076.059529:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330076.388515:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330076.388574:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330076.388589:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766044544 00000100:00100000:1.0:1788330076.388603:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766044544 00000100:00100000:2.0:1788330076.388618:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330076.388662:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 277 00000100:00100000:2.0:1788330076.388670:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330076.388676:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2413:x1875199766044544:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330076.388704:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330076.388741:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766045056 00000100:00100000:2.0:1788330076.388746:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766045056 00000100:00100000:1.0:1788330076.388779:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2413:x1875199766044544:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 108us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330076.388787:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 277 00000100:00100000:2.0:1788330076.388801:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766044928 00000100:00100000:2.0:1788330076.388806:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766044928 00000100:00100000:0.0:1788330076.388939:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766044800 00000100:00100000:0.0:1788330076.388945:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766044800 00000100:00100000:0.0:1788330076.388981:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766044672 00000100:00100000:0.0:1788330076.388985:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766044672 00000100:00100000:0.0:1788330076.389009:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 75 00000100:00100000:0.0:1788330076.389017:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766044800:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330076.389051:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766044800:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 36us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330076.389058:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 75 00000100:00100000:0.0:1788330076.389084:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 76 00000100:00100000:0.0:1788330076.389090:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2413:x1875199766044672:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330076.389117:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2413:x1875199766044672:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 27us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330076.389123:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 76 00000100:00100000:2.0:1788330076.391637:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:2.0:1788330076.391795:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766045056:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330076.391903:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766045056:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 250us (3284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330076.391913:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:2.0:1788330076.391941:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:2.0:1788330076.391952:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766044928:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330076.391987:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766044928:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 37us (3283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330076.392448:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00080000:3.0:1788330076.392777:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788330076.392787:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788330076.392793:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330076.392815:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330076.572085:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788330076.572124:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792322816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788330076.572253:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330076.572600:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792323328:0@lo:400:kworker.0 00000100:00100000:2.0:1788330076.572640:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330076.572709:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792323840:0@lo:400:kworker.0 00000100:00100000:2.0:1788330076.572747:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330076.572771:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792324352:0@lo:400:kworker.0 00000100:00100000:2.0:1788330076.572789:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330076.572815:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788330076.572819:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792322944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330076.572848:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792323072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330076.572887:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330076.572950:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792323328 00000100:00100000:0.0:1788330076.572960:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792323328 00000100:00100000:0.0:1788330076.573017:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792323840 00000100:00100000:0.0:1788330076.573021:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792323840 00000100:00100000:0.0:1788330076.573049:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792324352 00000100:00100000:0.0:1788330076.573052:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792324352 00000100:00100000:0.0:1788330076.573074:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788330076.573084:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792323328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330076.573180:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792323328:12345-0@lo:400:kworker.0 Request processed in 68us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330076.573188:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788330076.573209:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788330076.573216:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792323840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330076.573246:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792323840:12345-0@lo:400:kworker.0 Request processed in 32us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330076.573253:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788330076.573263:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788330076.573270:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792324352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330076.573316:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792324352:12345-0@lo:400:kworker.0 Request processed in 47us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330076.573323:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788330076.573370:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792323200:0@lo:400:kworker.0 00000100:00100000:0.0:1788330076.573403:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330076.573428:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792323712:0@lo:400:kworker.0 00000100:00100000:0.0:1788330076.573466:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792323200 00000100:00100000:0.0:1788330076.573470:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792323200 00000100:00100000:1.0:1788330076.579228:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792322816 00000100:00100000:1.0:1788330076.579247:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792322816 00000100:00100000:1.0:1788330076.579334:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788330076.579344:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792322816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788330076.579376:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330076.579663:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792322816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 179us (7270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330076.579672:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788330076.579743:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788330076.579747:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330076.579852:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330076.579892:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792323456:0@lo:400:kworker.0 00000100:00100000:1.0:1788330076.579930:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792322944 00000100:00100000:1.0:1788330076.579934:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792322944 00000100:00100000:1.0:1788330076.579959:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788330076.579965:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792322944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330076.579975:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330076.580003:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792322944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330076.580008:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788330076.580020:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788330076.581085:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792323584:0@lo:400:kworker.0 00000100:00100000:2.0:1788330076.581167:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788330076.582419:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc19880 x1875199792322816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330076.582468:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792322816:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330076.582649:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792324096:0@lo:400:kworker.0 00000100:00100000:2.0:1788330076.582701:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330076.582721:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792324608:0@lo:400:kworker.0 00000100:00100000:2.0:1788330076.582734:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330076.582815:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792323072 00000100:00100000:1.0:1788330076.582825:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792323072 00000100:00100000:1.0:1788330076.582892:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788330076.582917:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792323072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788330076.582950:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788330076.582963:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330076.583035:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792323072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330076.583061:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792323712 00000100:00100000:2.0:1788330076.583063:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792323712 00000100:00100000:2.0:1788330076.583077:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788330076.583081:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875199792323712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330076.584590:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875199792323072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1665us (11692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330076.584602:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788330076.584656:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788330076.584672:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3649:x1875199792323200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330076.584730:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3649:x1875199792323200:12345-0@lo:400:kworker.0 Request processed in 66us (11324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330076.584736:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788330076.584856:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330076.584896:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792323968:0@lo:400:kworker.0 00000100:00100000:1.0:1788330076.584931:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330076.584954:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792324480:0@lo:400:kworker.0 00000100:00100000:1.0:1788330076.584981:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330076.585022:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792323328:0@lo:400:kworker.0 00000100:00100000:1.0:1788330076.585036:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792323840:0@lo:400:kworker.0 00000100:00100000:1.0:1788330076.585050:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792324352:0@lo:400:kworker.0 00010000:00080000:1.0:1788330076.585087:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6da3480 x1875199792322944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330076.585104:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792322944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330076.585122:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792323456 00000100:00100000:1.0:1788330076.585127:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792323456 00000100:00100000:1.0:1788330076.585806:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788330076.585816:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792323456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330076.585875:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792323456:12345-0@lo:400:kworker.0 Request processed in 61us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330076.585881:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788330076.585903:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792323584 00000100:00100000:1.0:1788330076.585908:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792323584 00000100:00100000:1.0:1788330076.585930:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792323968 00000100:00100000:1.0:1788330076.585933:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792323968 00000100:00100000:1.0:1788330076.585957:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792324480 00000100:00100000:1.0:1788330076.585960:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792324480 00000100:00100000:1.0:1788330076.585974:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788330076.585979:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792323584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330076.586018:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792323584:12345-0@lo:400:kworker.0 Request processed in 39us (4852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330076.586025:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788330076.586036:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788330076.586042:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792323968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330076.586069:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792323968:12345-0@lo:400:kworker.0 Request processed in 27us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330076.586075:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788330076.586086:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788330076.586092:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792324480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330076.586120:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792324480:12345-0@lo:400:kworker.0 Request processed in 28us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330076.586126:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788330076.586142:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788330076.586215:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792323456:0@lo:400:kworker.0 00010000:00080000:1.0:1788330076.586228:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6da0380 x1875199792323968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330076.586239:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792323968:0@lo:400:kworker.0 00010000:00080000:1.0:1788330076.586250:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6ea1f80 x1875199792324480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330076.586258:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792324480:0@lo:400:kworker.0 00000100:00100000:3.0:1788330076.590445:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792324096 00000100:00100000:3.0:1788330076.590475:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792324096 00000100:00100000:1.0:1788330076.590508:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792324608 00000100:00100000:3.0:1788330076.590601:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788330076.590616:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792324096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330076.590758:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792324096:12345-0@lo:400:kworker.0 Request processed in 144us (8056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330076.590768:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788330076.590827:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330076.590877:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792324608 00000100:00100000:3.0:1788330076.590912:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792323584:0@lo:400:kworker.0 00010000:00080000:3.0:1788330076.590941:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6da0a80 x1875199792324096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330076.590959:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792324096:0@lo:400:kworker.0 00000100:00100000:1.0:1788330076.590961:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788330076.590982:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792324608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330076.591104:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792324608:12345-0@lo:400:kworker.0 Request processed in 127us (8367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330076.591112:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788330076.593414:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef58c8000 x1875199792324608/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330076.593438:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792324608:0@lo:400:kworker.0 00000100:00100000:0.0:1788330076.593968:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792324224:0@lo:400:kworker.0 00000100:00100000:2.0:1788330076.594027:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792323712:12345-0@lo:400:kworker.0 Request processed in 10931us (11056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330076.594044:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788330076.594060:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330076.594123:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792324736:0@lo:400:kworker.0 00000100:00100000:1.0:1788330076.594444:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792324224 00000100:00100000:1.0:1788330076.594463:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792324224 00000100:00100000:1.0:1788330076.594557:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788330076.594569:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefea0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792324224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330076.594630:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefea0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792324224:12345-0@lo:400:kworker.0 Request processed in 64us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330076.594638:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788330076.594952:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330076.595020:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792323200:0@lo:400:kworker.0 00000100:00100000:0.0:1788330076.595038:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792323712:0@lo:400:kworker.0 00010000:00080000:0.0:1788330076.595051:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6da2680 x1875199792324224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330076.595062:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792324224:0@lo:400:kworker.0 00000100:00100000:1.0:1788330076.595477:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792324736 00000100:00100000:1.0:1788330076.595485:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792324736 00000100:00100000:1.0:1788330076.595530:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788330076.595540:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792324736:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788330076.595593:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330076.595617:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792324736:12345-0@lo:400:kworker.0 Request processed in 79us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330076.595624:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788330076.595638:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef58c8380 x1875199792324736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330076.595661:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792324736:0@lo:400:kworker.0 00010000:00010000:2.0:1788330077.083367:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330078.117727:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788330078.117763:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792324864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330078.117886:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330078.117979:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792324864 00000100:00100000:2.0:1788330078.117989:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792324864 00000100:00100000:2.0:1788330078.118057:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788330078.118071:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792324864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330078.118113:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330078.118192:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792324864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330078.118200:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788330078.118226:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788330078.118263:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefe7efb80 x1875199792324864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330078.118284:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792324864:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788330078.118799:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330078.118813:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792324992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788330078.118853:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330078.118896:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792324992 00000100:00100000:0.0:1788330078.118901:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792324992 00000100:00100000:0.0:1788330078.118936:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788330078.118943:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792324992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788330078.118958:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330078.118990:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792324992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330078.119008:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788330078.119030:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788330078.119048:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc1b480 x1875199792324992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330078.119063:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792324992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788330079.132622:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792325120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330079.132723:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330079.132830:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792325120 00000100:00100000:0.0:1788330079.132841:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792325120 00000100:00100000:0.0:1788330079.132903:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788330079.132915:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792325120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788330079.132967:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788330079.133025:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792325120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330079.133033:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788330079.133104:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792325120:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788330079.140555:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330080.156192:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330081.180258:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330081.512108:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330081.512950:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766045184 00000100:00100000:0.0:1788330081.512963:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766045184 00000100:00100000:0.0:1788330081.513034:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 279 00000100:00100000:0.0:1788330081.513046:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2412:x1875199766045184:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330081.513134:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2412:x1875199766045184:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 90us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330081.513143:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 279 00000100:00100000:0.0:1788330081.524900:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330081.525430:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330081.535417:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766045312 00000100:00100000:3.0:1788330081.535495:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766045312 00000100:00100000:3.0:1788330081.535639:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766045440 00000100:00100000:3.0:1788330081.535644:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766045440 00000100:00100000:0.0:1788330081.535773:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 83 00000100:00100000:0.0:1788330081.535790:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2412:x1875199766045312:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330081.535883:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2412:x1875199766045312:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 99us (10996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330081.535890:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 83 00000100:00080000:2.0:1788330081.536535:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788330081.536541:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330081.537085:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 84 00000100:00100000:3.0:1788330081.537097:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766045440:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330081.537176:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766045440:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 82us (11747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330081.537183:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 84 00000100:00100000:0.0:1788330081.546119:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330081.546189:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330081.546339:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766045568 00000100:00100000:0.0:1788330081.546350:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766045568 00000100:00100000:0.0:1788330081.546429:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766045696 00000100:00100000:0.0:1788330081.546433:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766045696 00000100:00100000:0.0:1788330081.546531:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:0.0:1788330081.546541:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2409:x1875199766045568:12345-192.168.202.50@tcp:9:kworker.0 00000020:00000080:0.0:1788330081.546583:0:8440:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0eab 00000100:00080000:0.0:1788330081.546594:0:8440:0:(import.c:65:import_set_state_nolock()) ffff99edc75d1000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788330081.546708:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788330081.547008:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+2:2409:x1875199766045568:12345-192.168.202.50@tcp:9:kworker.0 Request processed in 467us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330081.547016:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:0.0:1788330081.547036:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:0.0:1788330081.547044:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2409:x1875199766045696:12345-192.168.202.50@tcp:9:kworker.0 00000020:00000080:0.0:1788330081.547059:0:8440:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0eb2 00000100:00080000:0.0:1788330081.547066:0:8440:0:(import.c:65:import_set_state_nolock()) ffff99edc7701800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788330081.547232:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788330081.547316:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+2:2409:x1875199766045696:12345-192.168.202.50@tcp:9:kworker.0 Request processed in 272us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330081.547322:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 19 00010000:00010000:0.0:1788330081.547431:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788330081.547963:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330081.547970:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788330081.547983:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330081.692987:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330081.693014:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792325248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330081.693089:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330081.693185:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792325248 00000100:00100000:0.0:1788330081.693192:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792325248 00000100:00100000:0.0:1788330081.693427:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788330081.693437:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792325248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788330081.693467:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330081.693513:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792325248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330081.693520:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788330081.693564:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc9d880 x1875199792325248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330097 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330081.693584:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792325248:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788330081.693701:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330081.694103:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788330081.694114:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792325376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330081.694171:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330081.694326:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792325376 00000100:00100000:0.0:1788330081.694332:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792325376 00000100:00100000:0.0:1788330081.694373:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788330081.694410:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792325376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330081.694438:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788330081.694476:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792325376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330081.694481:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788330081.694512:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792325376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330081.696716:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792325760:0@lo:400:kworker.0 00000100:00100000:3.0:1788330081.696787:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330081.696828:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792326272:0@lo:400:kworker.0 00000100:00100000:3.0:1788330081.696854:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330081.696882:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792326784:0@lo:400:kworker.0 00000100:00100000:1.0:1788330081.697205:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792325504:0@lo:400:kworker.0 00000100:00100000:1.0:1788330081.697242:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330081.697265:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792326016:0@lo:400:kworker.0 00000100:00100000:1.0:1788330081.697288:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330081.697303:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792326528:0@lo:400:kworker.0 00000100:00100000:1.0:1788330081.697324:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330081.697344:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788330081.697350:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792325888:0@lo:400:kworker.0 00000100:00100000:1.0:1788330081.697370:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330081.697384:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792326400:0@lo:400:kworker.0 00000100:00100000:1.0:1788330081.697425:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792325504 00000100:00100000:1.0:1788330081.697433:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792325504 00000100:00100000:1.0:1788330081.697478:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788330081.697488:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792325504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330081.697534:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792325504:12345-0@lo:400:kworker.0 Request processed in 48us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330081.697541:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788330081.699584:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330081.699675:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788330081.699691:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792325632:0@lo:400:kworker.0 00000100:00100000:3.0:1788330081.699751:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330081.699773:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792326144:0@lo:400:kworker.0 00000100:00100000:3.0:1788330081.699796:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330081.699829:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792326656:0@lo:400:kworker.0 00000100:00100000:3.0:1788330081.699850:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330081.699895:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792325760 00000100:00100000:3.0:1788330081.699902:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792325760 00000100:00100000:3.0:1788330081.700142:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788330081.700171:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792325760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330081.700302:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792325760:12345-0@lo:400:kworker.0 Request processed in 151us (3514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330081.700310:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788330081.700336:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792326272 00000100:00100000:3.0:1788330081.700340:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792326272 00000100:00100000:3.0:1788330081.700372:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792326784 00000100:00100000:3.0:1788330081.700375:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792326784 00000100:00100000:3.0:1788330081.700399:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788330081.700416:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792326272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330081.700449:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792326272:12345-0@lo:400:kworker.0 Request processed in 35us (3594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330081.700456:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788330081.700468:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788330081.700475:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792326784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330081.700502:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792326784:12345-0@lo:400:kworker.0 Request processed in 28us (3598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330081.700508:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788330081.700529:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792326016 00000100:00100000:3.0:1788330081.700533:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792326016 00000100:00100000:3.0:1788330081.700552:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792326528 00000100:00100000:3.0:1788330081.700555:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792326528 00000100:00100000:3.0:1788330081.700566:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792325888 00000100:00100000:3.0:1788330081.700577:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792325888 00000100:00100000:3.0:1788330081.700592:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792325632 00000100:00100000:3.0:1788330081.700595:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792325632 00000100:00100000:3.0:1788330081.700606:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792326144 00000100:00100000:3.0:1788330081.700608:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792326144 00000100:00100000:0.0:1788330081.702701:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792326656 00000100:00100000:0.0:1788330081.702711:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792326656 00000100:00100000:3.0:1788330081.702898:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788330081.702922:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792326016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330081.703011:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792326016:12345-0@lo:400:kworker.0 Request processed in 92us (5722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330081.703018:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788330081.703034:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788330081.703041:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792326528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330081.703073:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792326528:12345-0@lo:400:kworker.0 Request processed in 34us (5749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330081.703078:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788330081.703090:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788330081.703096:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792325888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330081.703123:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792325888:12345-0@lo:400:kworker.0 Request processed in 28us (5753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330081.703129:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788330081.703141:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788330081.703147:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792325632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330081.703193:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792325632:12345-0@lo:400:kworker.0 Request processed in 46us (3442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330081.703212:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788330081.703224:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788330081.704989:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792326912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330081.705064:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330081.705138:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330081.705206:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792325504:0@lo:400:kworker.0 00000100:00100000:1.0:1788330081.705247:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792326016:0@lo:400:kworker.0 00000100:00100000:1.0:1788330081.705257:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792326528:0@lo:400:kworker.0 00000100:00100000:1.0:1788330081.705282:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792325888:0@lo:400:kworker.0 00000100:00100000:0.0:1788330081.710354:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788330081.710372:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875199792326656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330081.710485:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875199792326656:12345-0@lo:400:kworker.0 Request processed in 118us (10633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330081.710493:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788330081.710634:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792326912 00000100:00100000:0.0:1788330081.710643:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792326912 00000100:00100000:0.0:1788330081.710674:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788330081.710680:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792326912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788330081.710701:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330081.710747:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792326912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (5683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330081.710754:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788330081.710805:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc9d880 x1875199792326912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330097 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330081.710827:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792326912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330081.717658:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792326400 00000100:00100000:0.0:1788330081.717703:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792326400 00000100:00100000:0.0:1788330081.717785:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788330081.717798:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792326400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330081.717939:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792326400:12345-0@lo:400:kworker.0 Request processed in 143us (12799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330081.717948:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788330081.717998:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef59dc700 x1875199792326400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330081.718015:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792326400:0@lo:400:kworker.0 00000100:00080000:0.0:1788330081.718043:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788330081.718050:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330081.718054:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330081.718057:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330081.718081:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792325632:0@lo:400:kworker.0 00010000:00080000:0.0:1788330081.718095:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef59dd500 x1875199792326656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330081.718105:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792326656:0@lo:400:kworker.0 00000100:00100000:0.0:1788330081.718117:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792325760:0@lo:400:kworker.0 00010000:00080000:0.0:1788330081.718128:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef59ddc00 x1875199792326272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330081.718135:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792326272:0@lo:400:kworker.0 00010000:00080000:0.0:1788330081.718145:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef59dc380 x1875199792326784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330081.718172:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792326784:0@lo:400:kworker.0 00000100:00100000:3.0:1788330081.719116:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792326144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330081.719460:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792326144:12345-0@lo:400:kworker.0 Request processed in 16229us (19661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330081.719470:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1788330081.719594:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef59de680 x1875199792326144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330081.719606:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792326144:0@lo:400:kworker.0 00000001:02000400:0.0:1788330082.111026:0:10942:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing yml_node 00010000:00010000:0.0:1788330082.205631:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330083.227568:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792327040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330083.227667:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330083.227740:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330083.227748:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792327168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788330083.227781:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330083.227814:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792327040 00000100:00100000:0.0:1788330083.227822:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792327040 00000100:00100000:0.0:1788330083.227864:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792327168 00000100:00100000:0.0:1788330083.227867:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792327168 00000100:00100000:0.0:1788330083.227882:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788330083.227891:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792327040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788330083.227918:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330083.227958:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792327040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330083.227965:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788330083.227982:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788330083.227987:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792327168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788330083.227996:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330083.228019:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792327168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 32us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330083.228025:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1788330083.228048:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788330083.228074:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc9ea00 x1875199792327168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330083.228093:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792327168:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788330083.228115:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc9d880 x1875199792327040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330083.228125:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792327040:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788330083.231095:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330084.251586:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788330084.251613:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792327296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330084.251688:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330084.252026:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330084.252551:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792327296 00000100:00100000:3.0:1788330084.252563:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792327296 00000100:00100000:3.0:1788330084.252632:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788330084.252643:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792327296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788330084.252685:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788330084.252763:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792327296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330084.252772:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788330084.252922:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792327296:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788330085.275963:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788330086.146408:0:11125:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.104 00010000:00010000:2.0:1788330086.302833:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330086.632651:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330086.632715:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330086.632744:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766045824 00000100:00100000:3.0:1788330086.632751:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330086.632763:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766045824 00000100:00100000:1.0:1788330086.632846:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 281 00000100:00100000:1.0:1788330086.632858:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2413:x1875199766045824:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330086.632955:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2413:x1875199766045824:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 99us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330086.632965:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 281 00000100:00100000:2.0:1788330086.633531:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766045952 00000100:00100000:2.0:1788330086.633538:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766045952 00000100:00080000:1.0:1788330086.633654:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330086.634722:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766046080 00000100:00100000:2.0:1788330086.634734:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766046080 00000100:00080000:1.0:1788330086.634924:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788330086.636190:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 91 00000100:00100000:3.0:1788330086.636214:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2412:x1875199766045952:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330086.636342:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2412:x1875199766045952:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 137us (3625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330086.636351:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 91 00000100:00100000:3.0:1788330086.636389:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 92 00000100:00100000:3.0:1788330086.636397:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766046080:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330086.636426:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766046080:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 30us (3677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330086.636432:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 92 00000100:00100000:2.0:1788330086.811543:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792327808:0@lo:400:kworker.0 00000100:00100000:2.0:1788330086.811651:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330086.811728:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792328320:0@lo:400:kworker.0 00000100:00100000:2.0:1788330086.811760:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330086.811786:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792328832:0@lo:400:kworker.0 00000100:00100000:2.0:1788330086.811827:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330086.811861:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788330086.811868:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792327680:0@lo:400:kworker.0 00000100:00100000:2.0:1788330086.811914:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330086.811936:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792328192:0@lo:400:kworker.0 00000100:00100000:2.0:1788330086.811958:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330086.811977:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792328704:0@lo:400:kworker.0 00000100:00100000:2.0:1788330086.811999:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330086.812035:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792327808 00000100:00100000:2.0:1788330086.812045:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792327808 00000100:00100000:2.0:1788330086.812099:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792328192 00000100:00100000:2.0:1788330086.812103:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792328192 00000100:00100000:2.0:1788330086.812130:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792328704 00000100:00100000:2.0:1788330086.812133:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792328704 00000100:00100000:2.0:1788330086.812180:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788330086.812192:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792327808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330086.812255:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792327808:12345-0@lo:400:kworker.0 Request processed in 64us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330086.812263:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788330086.812284:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788330086.812290:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792328192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330086.812318:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792328192:12345-0@lo:400:kworker.0 Request processed in 29us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330086.812325:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788330086.812336:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788330086.812343:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875199792328704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330086.812395:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875199792328704:12345-0@lo:400:kworker.0 Request processed in 53us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330086.812402:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788330086.812425:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792328320 00000100:00100000:2.0:1788330086.812429:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792328320 00000100:00100000:2.0:1788330086.812460:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792328832 00000100:00100000:2.0:1788330086.812463:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792328832 00000100:00100000:2.0:1788330086.812484:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788330086.812490:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792328320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330086.812522:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792328320:12345-0@lo:400:kworker.0 Request processed in 32us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330086.812527:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788330086.812537:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788330086.812543:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792328832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330086.812567:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792328832:12345-0@lo:400:kworker.0 Request processed in 25us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330086.812573:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788330086.812592:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792327680 00000100:00100000:2.0:1788330086.812595:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792327680 00000100:00100000:2.0:1788330086.812623:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788330086.812630:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792327680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330086.812664:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792327680:12345-0@lo:400:kworker.0 Request processed in 35us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330086.812670:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788330086.812696:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330086.812702:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788330086.812705:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788330086.812762:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792327680:0@lo:400:kworker.0 00010000:00080000:2.0:1788330086.812783:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefe7ef100 x1875199792328192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330086.812794:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792328192:0@lo:400:kworker.0 00010000:00080000:2.0:1788330086.812805:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefe7eea00 x1875199792328704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330086.812813:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792328704:0@lo:400:kworker.0 00000100:00100000:2.0:1788330086.812824:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792327808:0@lo:400:kworker.0 00010000:00080000:2.0:1788330086.812833:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefe7ec000 x1875199792328320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330086.812840:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792328320:0@lo:400:kworker.0 00010000:00080000:2.0:1788330086.812851:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefe7eed80 x1875199792328832/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330086.812858:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792328832:0@lo:400:kworker.0 00000100:00100000:0.0:1788330086.813130:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792327424:0@lo:400:kworker.0 00000100:00100000:0.0:1788330086.813191:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330086.813226:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792327936:0@lo:400:kworker.0 00000100:00100000:0.0:1788330086.813250:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330086.813268:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792328448:0@lo:400:kworker.0 00000100:00100000:0.0:1788330086.813289:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330086.813307:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792328960:0@lo:400:kworker.0 00000100:00100000:0.0:1788330086.813328:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330086.813349:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788330086.813367:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792327552:0@lo:400:kworker.0 00000100:00100000:0.0:1788330086.813390:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330086.813406:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792328064:0@lo:400:kworker.0 00000100:00100000:0.0:1788330086.813423:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330086.813436:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792328576:0@lo:400:kworker.0 00000100:00100000:0.0:1788330086.813453:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330086.813487:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792328448 00000100:00100000:0.0:1788330086.813492:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792328448 00000100:00100000:0.0:1788330086.813523:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792328960 00000100:00100000:0.0:1788330086.813526:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792328960 00000100:00100000:0.0:1788330086.813539:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788330086.813545:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792328448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330086.813594:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792328448:12345-0@lo:400:kworker.0 Request processed in 49us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330086.813600:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788330086.813616:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788330086.813622:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792328960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330086.813647:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792328960:12345-0@lo:400:kworker.0 Request processed in 26us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330086.813653:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788330086.813670:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792327552 00000100:00100000:0.0:1788330086.813673:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792327552 00000100:00100000:0.0:1788330086.813687:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792328064 00000100:00100000:0.0:1788330086.813689:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792328064 00000100:00100000:0.0:1788330086.813699:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792328576 00000100:00100000:0.0:1788330086.813701:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792328576 00000100:00100000:0.0:1788330086.813713:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788330086.813718:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792327552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330086.813743:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792327552:12345-0@lo:400:kworker.0 Request processed in 24us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330086.813749:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788330086.813758:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788330086.813763:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792328064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330086.813783:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792328064:12345-0@lo:400:kworker.0 Request processed in 20us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330086.813794:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788330086.813804:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788330086.813808:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792328576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330086.813830:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792328576:12345-0@lo:400:kworker.0 Request processed in 21us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330086.813835:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788330086.815707:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792329216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330086.815800:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330086.816044:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792329088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788330086.816082:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330086.816228:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792329088 00000100:00100000:3.0:1788330086.816237:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792329088 00000100:00100000:3.0:1788330086.816303:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788330086.816313:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792329088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788330086.816362:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330086.816419:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792329088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330086.816427:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788330086.816596:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc5ee9500 x1875199792329088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330102 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330086.816622:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792329088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330086.816851:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792327936 00000100:00100000:2.0:1788330086.816859:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792327936 00000100:00100000:2.0:1788330086.816896:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792329216 00000100:00100000:2.0:1788330086.816899:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792329216 00000100:00100000:2.0:1788330086.816912:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788330086.816921:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792327936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330086.816973:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792327936:12345-0@lo:400:kworker.0 Request processed in 55us (3722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330086.816980:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788330086.817014:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788330086.817020:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792329216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788330086.817043:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788330086.817075:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792329216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330086.817081:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788330086.817280:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792329344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330086.817317:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330086.817438:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792329344 00000100:00100000:1.0:1788330086.817443:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792329344 00000100:00100000:1.0:1788330086.817473:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788330086.817479:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792329344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330086.817492:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330086.817543:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792329344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330086.817556:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788330086.817960:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792329216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330086.818218:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792327424 00000100:00100000:0.0:1788330086.818234:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792327424 00000100:00100000:0.0:1788330086.818367:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788330086.818382:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3646:x1875199792327424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330086.818556:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3646:x1875199792327424:12345-0@lo:400:kworker.0 Request processed in 180us (5365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330086.818564:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:0.0:1788330086.818673:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330086.818680:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330086.818682:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330086.818719:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792327552:0@lo:400:kworker.0 00000100:00100000:0.0:1788330086.818732:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792328064:0@lo:400:kworker.0 00000100:00100000:0.0:1788330086.818741:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792328576:0@lo:400:kworker.0 00000100:00100000:0.0:1788330086.818750:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792327424:0@lo:400:kworker.0 00000100:00100000:0.0:1788330086.818760:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792327936:0@lo:400:kworker.0 00010000:00080000:2.0:1788330086.819100:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcf8380 x1875199792329344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330102 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330086.819123:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792329344:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788330086.819379:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefe7ef800 x1875199792328448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330086.819409:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792328448:0@lo:400:kworker.0 00010000:00080000:0.0:1788330086.819489:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefe7ed180 x1875199792328960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330086.819498:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792328960:0@lo:400:kworker.0 00000001:00100000:3.0:1788330086.819761:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00000020:00000080:3.0:1788330086.819768:0:9518:0:(genops.c:885:class_export_put()) final put ffff99edc7706800/f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00000001:00100000:3.0:1788330086.821259:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00000020:00000080:3.0:1788330086.821269:0:8433:0:(genops.c:885:class_export_put()) final put ffff99edc75d2800/f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00000020:00000080:1.0:1788330086.821343:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7706800/f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 for lustre-OST0001 00000020:00000080:2.0:1788330086.823701:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc7701800 for lustre-OST0001 00000020:00000080:2.0:1788330086.823716:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc75d2800/f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 for lustre-OST0000 00000020:00000080:2.0:1788330086.824344:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc75d1000 for lustre-OST0000 00010000:00010000:3.0:1788330087.330016:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330088.347533:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330088.349829:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330088.349866:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792329472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330088.349967:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330088.350060:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792329472 00000100:00100000:1.0:1788330088.350070:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792329472 00000100:00100000:1.0:1788330088.350146:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788330088.350186:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792329472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788330088.350228:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330088.350286:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792329472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330088.350294:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788330088.350322:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788330088.350373:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefe7ead80 x1875199792329472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330088.350399:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792329472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330088.355102:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792329600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330088.355248:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330088.355461:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792329600 00000100:00100000:2.0:1788330088.355472:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792329600 00000100:00100000:2.0:1788330088.355559:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788330088.355843:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330088.355879:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792329600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330088.355912:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330088.355993:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792329600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330088.356001:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788330088.356092:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcf8380 x1875199792329600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330088.356115:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792329600:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788330088.770635:0:11223:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.104 00010000:00010000:2.0:1788330089.372241:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330089.373181:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788330089.373215:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792329728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788330089.373325:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330089.373611:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792329728 00000100:00100000:2.0:1788330089.373621:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792329728 00000100:00100000:2.0:1788330089.373683:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788330089.373695:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792329728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788330089.373750:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788330089.373809:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792329728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330089.373817:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788330089.373884:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792329728:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788330090.396497:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788330091.229962:0:11320:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.104 00010000:00010000:3.0:1788330091.421381:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330091.745811:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330091.745939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330091.745985:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330091.746204:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766046464 00000100:00100000:2.0:1788330091.746220:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766046464 00000100:00100000:2.0:1788330091.746328:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766046336 00000100:00100000:2.0:1788330091.746332:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766046336 00000100:00100000:2.0:1788330091.746372:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 99 00000100:00100000:2.0:1788330091.746386:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766046464:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330091.746502:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766046464:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 120us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330091.746511:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 99 00000100:00100000:2.0:1788330091.746531:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 100 00000100:00100000:2.0:1788330091.746553:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766046336:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330091.746579:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766046336:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 42us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330091.746586:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 100 00000100:00080000:0.0:1788330091.746914:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330091.746921:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788330091.747880:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766046208 00000100:00100000:1.0:1788330091.747907:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766046208 00000100:00100000:1.0:1788330091.747979:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 283 00000100:00100000:1.0:1788330091.747991:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2410:x1875199766046208:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330091.748435:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2410:x1875199766046208:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 444us (2636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330091.748444:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 283 00000100:00100000:2.0:1788330091.931425:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792329984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330091.931545:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330091.931656:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792329856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330091.931687:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330091.931688:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792330112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330091.931735:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330091.931854:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792329984 00000100:00100000:3.0:1788330091.931867:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792329984 00000100:00100000:3.0:1788330091.931940:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792330112 00000100:00100000:3.0:1788330091.931944:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792330112 00000100:00100000:3.0:1788330091.931969:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788330091.931981:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792329984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330091.932027:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330091.932095:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792329984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330091.932103:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788330091.932122:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788330091.932129:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792330112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788330091.932139:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330091.932192:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792330112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330091.932198:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788330091.932220:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792329856 00000100:00100000:3.0:1788330091.932223:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792329856 00000100:00080000:0.0:1788330091.932268:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330091.932274:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788330091.932281:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792329856:12345-0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1788330091.932325:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc5eeaa00 x1875199792330112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000024:3.0:1788330091.932327:0:7831:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788330091.932357:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792330112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788330091.932365:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792329856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330091.932375:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1788330091.932409:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcf9880 x1875199792329984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330091.932422:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792329984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330091.932449:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792329856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330091.932471:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330091.932483:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792330368:0@lo:400:kworker.0 00000100:00100000:1.0:1788330091.932488:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792330240:0@lo:400:kworker.0 00000100:00100000:3.0:1788330091.932523:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330091.932678:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792330368 00000100:00100000:2.0:1788330091.932683:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792330368 00000100:00100000:2.0:1788330091.932723:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788330091.932732:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792330368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330091.932918:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792330624:0@lo:400:kworker.0 00000100:00100000:3.0:1788330091.932947:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792330880:0@lo:400:kworker.0 00000100:00100000:1.0:1788330091.939772:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330091.939869:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792330752:0@lo:400:kworker.0 00000100:00100000:1.0:1788330091.939936:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330091.939968:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792331264:0@lo:400:kworker.0 00000100:00100000:1.0:1788330091.939990:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330091.940057:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792330240 00000100:00100000:1.0:1788330091.940066:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792330240 00000100:00100000:1.0:1788330091.940129:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788330091.940139:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792330240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330091.940489:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792330240:12345-0@lo:400:kworker.0 Request processed in 351us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330091.940497:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788330091.940652:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792330752 00000100:00100000:1.0:1788330091.940657:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792330752 00000100:00100000:1.0:1788330091.940697:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792331264 00000100:00100000:1.0:1788330091.940700:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792331264 00000100:00100000:1.0:1788330091.940718:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788330091.940724:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792330752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330091.940758:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792330752:12345-0@lo:400:kworker.0 Request processed in 34us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330091.940781:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788330091.940795:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788330091.940801:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792331264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330091.940829:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792331264:12345-0@lo:400:kworker.0 Request processed in 29us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330091.940835:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1788330091.940876:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330091.940911:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792330752:0@lo:400:kworker.0 00000100:00100000:1.0:1788330091.940922:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792331264:0@lo:400:kworker.0 00000100:00100000:1.0:1788330091.940929:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792330240:0@lo:400:kworker.0 00000100:00100000:1.0:1788330091.941077:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792330496:0@lo:400:kworker.0 00000100:00100000:1.0:1788330091.941122:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330091.941145:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792331008:0@lo:400:kworker.0 00000100:00100000:1.0:1788330091.941320:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330091.941359:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792331008 00000100:00100000:1.0:1788330091.941364:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792331008 00000100:00100000:1.0:1788330091.941472:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788330091.941481:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792331008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330091.941521:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792331008:12345-0@lo:400:kworker.0 Request processed in 42us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330091.941528:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788330091.941662:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330091.941684:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792330496 00000100:00100000:1.0:1788330091.941688:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792330496 00000100:00100000:1.0:1788330091.941726:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788330091.941732:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792330496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330091.941771:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792330496:12345-0@lo:400:kworker.0 Request processed in 39us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330091.941776:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788330091.942020:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330091.942071:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792331136:0@lo:400:kworker.0 00000100:00100000:0.0:1788330091.942106:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330091.942204:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792331136 00000100:00100000:0.0:1788330091.942212:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792331136 00000100:00100000:0.0:1788330091.942273:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788330091.942281:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792331136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330091.942347:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792331136:12345-0@lo:400:kworker.0 Request processed in 66us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330091.942354:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788330091.942461:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792330368:12345-0@lo:400:kworker.0 Request processed in 9729us (9937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330091.942472:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788330091.942492:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792330624 00000100:00100000:2.0:1788330091.942495:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792330624 00000100:00100000:2.0:1788330091.942522:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788330091.942529:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792330624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330091.942575:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792330624:12345-0@lo:400:kworker.0 Request processed in 47us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330091.942582:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788330091.942630:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792330368:0@lo:400:kworker.0 00000100:00080000:1.0:1788330091.942631:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330091.942657:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792330624:0@lo:400:kworker.0 00000100:00100000:2.0:1788330091.942661:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792330496:0@lo:400:kworker.0 00010000:00080000:1.0:1788330091.942672:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7798700 x1875199792331136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788330091.942674:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7799f80 x1875199792331008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330091.942683:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792331136:0@lo:400:kworker.0 00000100:00100000:2.0:1788330091.942684:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792331008:0@lo:400:kworker.0 00000100:00100000:3.0:1788330091.943830:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330091.943929:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792331392:0@lo:400:kworker.0 00000100:00100000:3.0:1788330091.943962:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330091.947591:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792330880 00000100:00100000:1.0:1788330091.947612:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792330880 00000100:00100000:1.0:1788330091.947704:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792331392 00000100:00100000:1.0:1788330091.947708:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792331392 00000100:00100000:1.0:1788330091.947742:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788330091.947754:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792330880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330091.947868:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792330880:12345-0@lo:400:kworker.0 Request processed in 116us (4040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330091.947876:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788330091.947894:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788330091.947900:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792331392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330091.947929:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792331392:12345-0@lo:400:kworker.0 Request processed in 29us (3966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330091.947935:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1788330091.948022:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788330091.948070:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc779ad80 x1875199792330880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330091.948089:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792330880:0@lo:400:kworker.0 00010000:00080000:3.0:1788330091.948104:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7798380 x1875199792331392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330091.948112:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792331392:0@lo:400:kworker.0 00010000:00010000:3.0:1788330092.448108:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788330092.753110:0:11368:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 2 02:21:31 EDT 2026 00000100:00100000:3.0:1788330093.467654:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792331520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330093.467763:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330093.467996:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792331520 00000100:00100000:1.0:1788330093.468006:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792331520 00000100:00100000:1.0:1788330093.468085:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788330093.468094:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792331520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788330093.468132:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330093.468215:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792331520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330093.468222:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788330093.468279:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefe7ebb80 x1875199792331520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330093.468308:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792331520:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788330093.468402:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788330093.468499:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330093.468739:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792331648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330093.468789:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330093.468948:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792331648 00000100:00100000:3.0:1788330093.468954:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792331648 00000100:00100000:3.0:1788330093.469078:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788330093.469088:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792331648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330093.469107:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330093.469187:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792331648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330093.469195:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788330093.469248:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788330093.469318:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcf8000 x1875199792331648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330093.469344:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792331648:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788330094.498292:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330094.498479:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330094.498503:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792331776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330094.498605:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330094.498681:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792331776 00000100:00100000:0.0:1788330094.498689:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792331776 00000100:00100000:0.0:1788330094.499254:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788330094.499268:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792331776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788330094.499312:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788330094.499462:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792331776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 199us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330094.499470:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788330094.499525:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792331776:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788330095.515559:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330096.539508:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330096.866017:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330096.866061:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330096.866360:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766046720 00000100:00100000:0.0:1788330096.866373:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766046720 00000100:00100000:0.0:1788330096.866498:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 107 00000100:00100000:0.0:1788330096.866510:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2411:x1875199766046720:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330096.866598:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2411:x1875199766046720:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 91us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330096.866628:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 107 00000100:00100000:2.0:1788330096.866926:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766046592 00000100:00100000:2.0:1788330096.866933:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766046592 00000100:00100000:2.0:1788330096.866974:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 285 00000100:00100000:2.0:1788330096.866990:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2411:x1875199766046592:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330096.867028:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2411:x1875199766046592:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 40us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330096.867035:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 285 00000100:00100000:1.0:1788330096.870314:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00080000:3.0:1788330096.870397:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330096.870429:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766046848 00000100:00100000:0.0:1788330096.870439:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766046848 00000100:00100000:0.0:1788330096.870598:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 108 00000100:00080000:3.0:1788330096.870599:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788330096.870610:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766046848:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330096.870704:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766046848:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 96us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330096.870712:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 108 00000100:00100000:3.0:1788330097.051400:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792331904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330097.051514:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330097.051611:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330097.051621:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792332032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788330097.051651:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330097.051708:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792332032 00000100:00100000:3.0:1788330097.051718:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792332032 00000100:00100000:3.0:1788330097.051792:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788330097.051804:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792332032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788330097.051845:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330097.051913:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792332032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330097.051924:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792332160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330097.051925:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788330097.051970:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330097.052015:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788330097.052040:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc5ee9500 x1875199792332032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330097.052069:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792332032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788330097.052107:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792332160 00000100:00100000:3.0:1788330097.052111:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792332160 00000100:00100000:1.0:1788330097.052177:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792331904 00000100:00100000:1.0:1788330097.052187:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792331904 00000100:00100000:3.0:1788330097.052212:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788330097.052223:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792332160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330097.052237:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330097.052253:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788330097.052278:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792331904:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330097.052303:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792332160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330097.052317:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00000024:1.0:1788330097.052319:0:7831:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00080000:0.0:1788330097.052520:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330097.052597:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792331904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 322us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330097.052605:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:3.0:1788330097.052635:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7798380 x1875199792332160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330097.052654:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792332160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330097.052677:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792332672:0@lo:400:kworker.0 00000100:00100000:3.0:1788330097.052737:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330097.052773:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792333184:0@lo:400:kworker.0 00000100:00100000:0.0:1788330097.052793:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792332672 00000100:00100000:0.0:1788330097.052802:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792332672 00000100:00100000:3.0:1788330097.052816:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330097.052854:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788330097.052866:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792332672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330097.052872:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788330097.052884:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792332288:0@lo:400:kworker.0 00000100:00100000:0.0:1788330097.052939:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792332672:12345-0@lo:400:kworker.0 Request processed in 74us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330097.052947:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330097.052983:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792332800:0@lo:400:kworker.0 00000100:00100000:0.0:1788330097.053013:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788330097.053124:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330097.053214:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792333184 00000100:00100000:1.0:1788330097.053220:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792333184 00000100:00100000:1.0:1788330097.053282:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788330097.053293:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792333184:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788330097.053326:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330097.053348:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792333184:12345-0@lo:400:kworker.0 Request processed in 57us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330097.053357:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788330097.053467:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792333312:0@lo:400:kworker.0 00000100:00100000:3.0:1788330097.053495:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330097.055694:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792332672:0@lo:400:kworker.0 00010000:00080000:3.0:1788330097.055724:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcf9c00 x1875199792333184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330097.056942:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792333184:0@lo:400:kworker.0 00000100:00100000:3.0:1788330097.057178:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792332288 00000100:00100000:3.0:1788330097.057189:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792332288 00000100:00100000:3.0:1788330097.057248:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788330097.057271:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3646:x1875199792332288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330097.057663:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3646:x1875199792332288:12345-0@lo:400:kworker.0 Request processed in 404us (4717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330097.057724:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792332288:0@lo:400:kworker.0 00000100:00100000:3.0:1788330097.057779:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788330097.057843:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792332544:0@lo:400:kworker.0 00000100:00100000:3.0:1788330097.057884:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330097.057920:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792333056:0@lo:400:kworker.0 00000100:00100000:1.0:1788330097.058138:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792332544 00000100:00100000:1.0:1788330097.058145:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792332544 00000100:00100000:1.0:1788330097.058373:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788330097.058384:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792332544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330097.058603:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330097.058636:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792332544:12345-0@lo:400:kworker.0 Request processed in 254us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330097.058644:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788330097.058736:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792332544:0@lo:400:kworker.0 00000100:00100000:3.0:1788330097.058751:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788330097.058761:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792332416:0@lo:400:kworker.0 00000100:00100000:3.0:1788330097.058796:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330097.060338:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792332800 00000100:00100000:2.0:1788330097.060360:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792332800 00000100:00100000:0.0:1788330097.060363:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792333312 00000100:00100000:0.0:1788330097.060445:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792333312 00000100:00100000:2.0:1788330097.060472:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788330097.060490:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792332800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330097.060544:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788330097.060560:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792333312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330097.060609:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792332800:12345-0@lo:400:kworker.0 Request processed in 124us (7483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330097.060619:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788330097.060672:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792333312:12345-0@lo:400:kworker.0 Request processed in 116us (7174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330097.060682:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788330097.060789:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792332928:0@lo:400:kworker.0 00000100:00100000:3.0:1788330097.060840:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330097.060877:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792333440:0@lo:400:kworker.0 00000100:00100000:3.0:1788330097.060904:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788330097.062135:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330097.062231:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792332800:0@lo:400:kworker.0 00000100:00100000:1.0:1788330097.062251:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792333312:0@lo:400:kworker.0 00000100:00100000:3.0:1788330097.062482:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792333056 00000100:00100000:3.0:1788330097.062492:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792333056 00000100:00100000:3.0:1788330097.062576:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788330097.062586:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792333056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330097.062669:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792333056:12345-0@lo:400:kworker.0 Request processed in 84us (4722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330097.062697:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788330097.062756:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792331904:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1788330097.062794:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcfa680 x1875199792333056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330097.062806:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792333056:0@lo:400:kworker.0 00000100:00100000:2.0:1788330097.062895:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792332416 00000100:00100000:2.0:1788330097.062900:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792332416 00000100:00100000:2.0:1788330097.062941:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792332928 00000100:00100000:2.0:1788330097.062945:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792332928 00000100:00100000:2.0:1788330097.062976:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792333440 00000100:00100000:2.0:1788330097.062980:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792333440 00000100:00080000:1.0:1788330097.063094:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788330097.063099:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330097.063266:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788330097.063279:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792332416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330097.063329:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792332416:12345-0@lo:400:kworker.0 Request processed in 55us (4532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330097.063337:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788330097.063352:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788330097.063360:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792332928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330097.063390:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792332928:12345-0@lo:400:kworker.0 Request processed in 32us (2550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330097.063397:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788330097.063418:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788330097.063425:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875199792333440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330097.063458:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875199792333440:12345-0@lo:400:kworker.0 Request processed in 34us (2553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330097.063465:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788330097.065557:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792332416:0@lo:400:kworker.0 00010000:00080000:1.0:1788330097.065583:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcf8a80 x1875199792332928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330097.065596:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792332928:0@lo:400:kworker.0 00010000:00080000:1.0:1788330097.065609:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcf9880 x1875199792333440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330097.065618:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792333440:0@lo:400:kworker.0 00010000:00010000:0.0:1788330097.564642:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330098.587951:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792333568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330098.588079:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792333696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330098.588147:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330098.588252:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792333696 00000100:00100000:1.0:1788330098.588261:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792333696 00000100:00100000:1.0:1788330098.588323:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788330098.588330:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792333696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330098.588359:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330098.588397:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792333696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330098.588508:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330098.588551:0:8442:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788330098.588558:0:8442:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00010000:00010000:2.0:1788330098.589272:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788330098.589326:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc5ee9500 x1875199792333696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330098.589346:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792333696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330098.589372:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792333568 00000100:00100000:3.0:1788330098.589377:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792333568 00000100:00100000:1.0:1788330098.590371:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788330098.594609:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788330098.594636:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792333568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788330098.595046:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330098.595288:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792333568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 663us (6778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330098.595297:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788330098.599251:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc5eeaa00 x1875199792333568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330098.599283:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792333568:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788330099.611677:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330099.612987:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792333824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330099.613096:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330099.613210:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792333824 00000100:00100000:0.0:1788330099.613220:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792333824 00000100:00100000:0.0:1788330099.613289:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788330099.613300:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792333824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788330099.613339:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788330099.613397:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792333824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330099.613404:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788330099.613492:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792333824:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788330100.639296:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330101.659290:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330101.989373:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330101.989429:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330101.989464:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330101.989504:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766047232 00000100:00100000:0.0:1788330101.989519:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766047232 00000100:00100000:0.0:1788330101.989596:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766047104 00000100:00100000:0.0:1788330101.989599:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766047104 00000100:00100000:0.0:1788330101.989628:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 115 00000100:00100000:0.0:1788330101.989641:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766047232:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330101.989753:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766047232:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 115us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330101.989761:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 115 00000100:00100000:0.0:1788330101.989783:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 116 00000100:00100000:0.0:1788330101.989790:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766047104:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330101.989821:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766047104:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 32us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330101.989827:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 116 00000100:00080000:0.0:1788330101.989851:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330101.989884:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788330101.991106:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766046976 00000100:00100000:3.0:1788330101.991118:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766046976 00000100:00100000:3.0:1788330101.991306:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 287 00000100:00100000:3.0:1788330101.991317:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2410:x1875199766046976:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330101.991389:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2410:x1875199766046976:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 75us (2032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330101.991397:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 287 00000100:00100000:3.0:1788330102.172012:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792334080:0@lo:400:kworker.0 00000100:00100000:3.0:1788330102.172116:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330102.172196:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792334592:0@lo:400:kworker.0 00000100:00100000:3.0:1788330102.172229:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330102.172260:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7cff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792335104:0@lo:400:kworker.0 00000100:00100000:3.0:1788330102.172283:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330102.172340:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792334080 00000100:00100000:0.0:1788330102.172351:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792334080 00000100:00100000:0.0:1788330102.172412:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792334592 00000100:00100000:0.0:1788330102.172416:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792334592 00000100:00100000:1.0:1788330102.172428:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792334336:0@lo:400:kworker.0 00000100:00100000:0.0:1788330102.172439:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792335104 00000100:00100000:0.0:1788330102.172442:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792335104 00000100:00100000:1.0:1788330102.172462:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330102.172470:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792334336 00000100:00100000:0.0:1788330102.172473:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792334336 00000100:00100000:1.0:1788330102.172478:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792334848:0@lo:400:kworker.0 00000100:00100000:0.0:1788330102.172490:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788330102.172500:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792334080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330102.172504:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330102.172523:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792335360:0@lo:400:kworker.0 00000100:00100000:1.0:1788330102.172541:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330102.172562:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788330102.172562:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792334080:12345-0@lo:400:kworker.0 Request processed in 62us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330102.172568:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792334208:0@lo:400:kworker.0 00000100:00100000:0.0:1788330102.172569:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788330102.172590:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788330102.172592:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330102.172595:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792334592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330102.172609:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792334720:0@lo:400:kworker.0 00000100:00100000:0.0:1788330102.172622:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792334592:12345-0@lo:400:kworker.0 Request processed in 26us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330102.172628:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788330102.172629:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330102.172638:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792334720 00000100:00100000:1.0:1788330102.172639:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792335232:0@lo:400:kworker.0 00000100:00100000:0.0:1788330102.172641:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792334720 00000100:00100000:0.0:1788330102.172658:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788330102.172663:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792335104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330102.172670:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330102.172681:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792335744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330102.172686:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792335104:12345-0@lo:400:kworker.0 Request processed in 24us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330102.172692:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788330102.172701:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330102.172703:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792335232 00000100:00100000:0.0:1788330102.172705:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792335232 00000100:00100000:0.0:1788330102.172720:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788330102.172731:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792334848 00000100:00100000:1.0:1788330102.172734:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792334848 00000100:00100000:0.0:1788330102.172735:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792334336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330102.172766:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792335360 00000100:00100000:0.0:1788330102.172768:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792334336:12345-0@lo:400:kworker.0 Request processed in 35us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330102.172769:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792335360 00000100:00100000:0.0:1788330102.172774:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788330102.172785:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788330102.172790:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788330102.172791:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792334720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330102.172797:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792334848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330102.172818:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792334720:12345-0@lo:400:kworker.0 Request processed in 27us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330102.172824:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792334848:12345-0@lo:400:kworker.0 Request processed in 29us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330102.172824:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788330102.172830:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788330102.172834:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788330102.172840:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792335232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330102.172841:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788330102.172847:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792335360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330102.172864:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792335232:12345-0@lo:400:kworker.0 Request processed in 24us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330102.172869:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792335360:12345-0@lo:400:kworker.0 Request processed in 23us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330102.172870:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788330102.172874:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788330102.172894:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792334208 00000100:00080000:0.0:1788330102.172896:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330102.172898:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792334208 00000100:00080000:0.0:1788330102.172901:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788330102.172904:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788330102.172906:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330102.172920:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788330102.172927:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792334208:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788330102.172954:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc6607480 x1875199792334720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330102.172963:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792334208:12345-0@lo:400:kworker.0 Request processed in 37us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330102.172968:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788330102.172972:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6607480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792334720:0@lo:400:kworker.0 00010000:00080000:0.0:1788330102.172984:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7cfc000 x1875199792335232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330102.172988:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792335744 00000100:00100000:1.0:1788330102.172991:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792335744 00000100:00100000:0.0:1788330102.172992:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792335232:0@lo:400:kworker.0 00000100:00100000:0.0:1788330102.173003:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792334336:0@lo:400:kworker.0 00000100:00100000:1.0:1788330102.173015:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1788330102.173021:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc6604e00 x1875199792334848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330102.173027:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792335744:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330102.173030:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792334848:0@lo:400:kworker.0 00010000:00080000:0.0:1788330102.173053:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7cff800 x1875199792335360/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:1.0:1788330102.173055:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330102.173061:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792335360:0@lo:400:kworker.0 00000100:00100000:1.0:1788330102.173087:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792335744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330102.173093:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788330102.173103:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792334208:0@lo:400:kworker.0 00010000:00080000:0.0:1788330102.173113:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eee7640e00 x1875199792335744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330102.173126:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792335744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788330102.173368:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7cff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792335104:0@lo:400:kworker.0 00000100:00100000:3.0:1788330102.173391:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792335616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330102.173420:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330102.173490:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792334080:0@lo:400:kworker.0 00000100:00100000:3.0:1788330102.173502:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6605880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792334592:0@lo:400:kworker.0 00000100:00100000:3.0:1788330102.173515:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788330102.173521:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792333952:0@lo:400:kworker.0 00000100:00100000:3.0:1788330102.173552:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330102.173576:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792334464:0@lo:400:kworker.0 00000100:00100000:3.0:1788330102.173596:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330102.173784:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792334976:0@lo:400:kworker.0 00000100:00100000:3.0:1788330102.173811:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330102.173829:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792335488:0@lo:400:kworker.0 00000100:00100000:3.0:1788330102.173850:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330102.173878:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792333952 00000100:00100000:3.0:1788330102.173883:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792333952 00000100:00100000:3.0:1788330102.173917:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788330102.173925:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3649:x1875199792333952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330102.173977:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3649:x1875199792333952:12345-0@lo:400:kworker.0 Request processed in 53us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330102.173984:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788330102.174030:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792334976 00000100:00100000:3.0:1788330102.174035:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792334976 00000100:00100000:3.0:1788330102.174066:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792335488 00000100:00100000:3.0:1788330102.174069:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792335488 00000100:00100000:3.0:1788330102.174090:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788330102.174097:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792334976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330102.174133:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792334976:12345-0@lo:400:kworker.0 Request processed in 37us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330102.174139:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788330102.174177:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788330102.174185:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792335488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330102.174231:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792335488:12345-0@lo:400:kworker.0 Request processed in 47us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330102.174237:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788330102.174253:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330102.174258:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330102.174283:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792333952:0@lo:400:kworker.0 00010000:00080000:3.0:1788330102.174295:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef59de300 x1875199792334976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330102.174317:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792334976:0@lo:400:kworker.0 00000100:00100000:2.0:1788330102.174322:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00080000:3.0:1788330102.174327:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7cfe300 x1875199792335488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330102.174333:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792335872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330102.174347:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792335488:0@lo:400:kworker.0 00000100:00100000:2.0:1788330102.174368:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330102.174397:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792335872 00000100:00100000:2.0:1788330102.174400:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792335872 00000100:00100000:2.0:1788330102.174439:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788330102.174457:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792335872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788330102.174470:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330102.174504:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792335872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330102.174510:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788330102.174512:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcf8380 x1875199792335872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330102.174524:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792335872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330102.176019:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792334464 00000100:00100000:0.0:1788330102.176034:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792334464 00000100:00100000:0.0:1788330102.176100:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788330102.176111:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792334464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330102.176360:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792335616 00000100:00100000:1.0:1788330102.176367:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792335616 00000100:00100000:0.0:1788330102.177077:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875199792334464:12345-0@lo:400:kworker.0 Request processed in 961us (3472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330102.177089:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788330102.177249:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788330102.177258:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792335616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330102.177310:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788330102.177357:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792335616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (3937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330102.177364:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788330102.177460:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792334464:0@lo:400:kworker.0 00000100:00100000:3.0:1788330102.177481:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792335616:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788330102.685455:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330103.707555:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330103.708421:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330103.708464:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792336000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330103.708572:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330103.708651:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792336128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330103.708677:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330103.708719:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792336000 00000100:00100000:1.0:1788330103.708733:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792336000 00000100:00100000:0.0:1788330103.708778:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792336128 00000100:00100000:0.0:1788330103.708782:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792336128 00000100:00100000:1.0:1788330103.708803:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788330103.709049:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792336000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330103.709091:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330103.709183:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792336000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (611us total) trans 0 rc 0/0 00010000:00080000:2.0:1788330103.709261:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6d40700 x1875199792336000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330103.709285:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792336000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330103.715419:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788330103.715501:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788330103.718620:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792336128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788330103.718673:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330103.718961:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792336128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3521us (10280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330103.718973:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1788330103.724240:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7798380 x1875199792336128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330103.724276:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792336128:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788330104.734594:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330104.736567:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788330104.736604:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792336256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330104.736726:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330104.736851:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792336256 00000100:00100000:0.0:1788330104.736865:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792336256 00000100:00100000:0.0:1788330104.736935:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788330104.736949:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792336256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788330104.737012:0:7831:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788330104.737085:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792336256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330104.737093:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788330104.737204:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792336256:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788330105.760127:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330106.781507:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330107.107117:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330107.107232:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330107.107366:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330107.107433:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766047360 00000100:00100000:1.0:1788330107.107448:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766047360 00000100:00100000:1.0:1788330107.107530:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 289 00000100:00100000:1.0:1788330107.107560:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2411:x1875199766047360:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330107.107665:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2411:x1875199766047360:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 109us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330107.107673:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 289 00000100:00100000:2.0:1788330107.122624:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766047616 00000100:00100000:2.0:1788330107.122645:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766047616 00000100:00100000:2.0:1788330107.122772:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766047488 00000100:00100000:2.0:1788330107.122776:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766047488 00000100:00100000:2.0:1788330107.122811:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 123 00000100:00100000:2.0:1788330107.122826:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766047616:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330107.122951:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766047616:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 128us (15718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330107.122959:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 123 00000100:00100000:2.0:1788330107.122981:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 124 00000100:00100000:2.0:1788330107.122987:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2411:x1875199766047488:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330107.123010:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2411:x1875199766047488:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 24us (15645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330107.123016:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 124 00000100:00080000:0.0:1788330107.123254:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330107.123261:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788330107.293035:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792336384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330107.293179:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330107.293409:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792336384 00000100:00100000:1.0:1788330107.293422:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792336384 00000100:00100000:1.0:1788330107.293524:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788330107.293537:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792336384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788330107.293582:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330107.293639:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792336384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330107.293646:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1788330107.294388:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788330107.294438:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6d41500 x1875199792336384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330123 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330107.295244:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792336384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330107.295867:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788330107.296051:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792336512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330107.296135:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330107.296255:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792336512 00000100:00100000:2.0:1788330107.296267:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792336512 00000100:00100000:2.0:1788330107.296338:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788330107.296347:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792336512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788330107.296384:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330107.296429:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792336512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330107.296437:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1788330107.296472:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788330107.297340:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcf8a80 x1875199792336512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330123 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330107.297366:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792336512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330107.298196:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792336768:0@lo:400:kworker.0 00000100:00100000:3.0:1788330107.298308:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330107.298351:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792337280:0@lo:400:kworker.0 00000100:00100000:3.0:1788330107.298372:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330107.298406:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792337792:0@lo:400:kworker.0 00000100:00100000:3.0:1788330107.298428:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330107.298457:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788330107.298473:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792336896:0@lo:400:kworker.0 00000100:00100000:3.0:1788330107.298507:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330107.298532:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792337408:0@lo:400:kworker.0 00000100:00100000:3.0:1788330107.298552:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330107.299695:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792337920:0@lo:400:kworker.0 00000100:00100000:3.0:1788330107.299763:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330107.300055:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792336768 00000100:00100000:1.0:1788330107.300067:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792336768 00000100:00100000:1.0:1788330107.300117:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792337280 00000100:00100000:1.0:1788330107.300121:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792337280 00000100:00100000:1.0:1788330107.300176:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792337792 00000100:00100000:1.0:1788330107.300179:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792337792 00000100:00100000:1.0:1788330107.300194:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792337408 00000100:00100000:1.0:1788330107.300196:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792337408 00000100:00100000:1.0:1788330107.300209:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792337920 00000100:00100000:1.0:1788330107.300211:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792337920 00000100:00100000:1.0:1788330107.300288:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788330107.300303:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792336768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330107.300461:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792336896 00000100:00100000:0.0:1788330107.300465:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792336896 00000100:00100000:0.0:1788330107.300509:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788330107.301073:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788330107.301098:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792337280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330107.301182:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792336640:0@lo:400:kworker.0 00000100:00100000:1.0:1788330107.301378:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792336768:12345-0@lo:400:kworker.0 Request processed in 1077us (3069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330107.301387:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788330107.301413:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788330107.301428:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792337792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330107.301470:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792337792:12345-0@lo:400:kworker.0 Request processed in 44us (3041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330107.301476:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788330107.301488:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788330107.301495:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792337408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330107.301533:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792337408:12345-0@lo:400:kworker.0 Request processed in 39us (2980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330107.301539:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788330107.301549:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788330107.301555:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792337920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330107.301744:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792336896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330107.302072:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792336896:12345-0@lo:400:kworker.0 Request processed in 1556us (3563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330107.302080:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788330107.302180:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792337024:0@lo:400:kworker.0 00000100:00100000:0.0:1788330107.302217:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330107.302257:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792337536:0@lo:400:kworker.0 00000100:00100000:0.0:1788330107.302284:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330107.302316:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792338048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330107.302338:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330107.302369:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792338048 00000100:00100000:0.0:1788330107.302377:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792338048 00000100:00100000:0.0:1788330107.302409:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788330107.302415:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792338048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330107.302445:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788330107.302500:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792338048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330107.302506:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788330107.302706:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792337280:12345-0@lo:400:kworker.0 Request processed in 1609us (4330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330107.302716:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788330107.302732:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792337024 00000100:00100000:3.0:1788330107.302735:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792337024 00000100:00100000:3.0:1788330107.302756:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788330107.302761:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792337024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330107.302802:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792337024:12345-0@lo:400:kworker.0 Request processed in 40us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330107.302807:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788330107.302827:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792337536 00000100:00100000:3.0:1788330107.302830:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792337536 00000100:00100000:3.0:1788330107.302879:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788330107.302897:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792337536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330107.302931:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792337536:12345-0@lo:400:kworker.0 Request processed in 46us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330107.302937:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788330107.302976:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792336896:0@lo:400:kworker.0 00010000:00080000:3.0:1788330107.302994:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc76dd500 x1875199792337408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330107.303006:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792337408:0@lo:400:kworker.0 00000100:00100000:3.0:1788330107.303020:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792336768:0@lo:400:kworker.0 00000100:00100000:3.0:1788330107.303030:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792337280:0@lo:400:kworker.0 00000100:00100000:3.0:1788330107.303062:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792337792:0@lo:400:kworker.0 00000100:00080000:3.0:1788330107.303115:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330107.303122:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788330107.303124:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330107.303392:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792338048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330107.303422:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792337024:0@lo:400:kworker.0 00010000:00080000:0.0:1788330107.303434:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc76ddc00 x1875199792337536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330107.303457:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792337536:0@lo:400:kworker.0 00000100:00100000:2.0:1788330107.304385:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330107.304447:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792337152:0@lo:400:kworker.0 00000100:00100000:2.0:1788330107.304492:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330107.304812:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792337664:0@lo:400:kworker.0 00000100:00100000:2.0:1788330107.304856:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330107.305615:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792337664 00000100:00100000:2.0:1788330107.305626:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792337664 00000100:00100000:2.0:1788330107.305708:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788330107.305720:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792337664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330107.305808:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792337664:12345-0@lo:400:kworker.0 Request processed in 90us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330107.305815:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788330107.305843:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788330107.305885:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc76de680 x1875199792337664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330107.305910:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792337664:0@lo:400:kworker.0 00000100:00100000:3.0:1788330107.306289:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792336640 00000100:00100000:3.0:1788330107.306296:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792336640 00000100:00100000:3.0:1788330107.306345:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788330107.306353:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3649:x1875199792336640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330107.306401:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3649:x1875199792336640:12345-0@lo:400:kworker.0 Request processed in 50us (2021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330107.306408:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788330107.306747:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792337920:12345-0@lo:400:kworker.0 Request processed in 5189us (6981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330107.306759:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:3.0:1788330107.307014:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fd180 x1875199792337920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330107.307028:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792337920:0@lo:400:kworker.0 00000100:00100000:2.0:1788330107.307207:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792336640:0@lo:400:kworker.0 00000100:00100000:0.0:1788330107.307679:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792337152 00000100:00100000:0.0:1788330107.307688:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792337152 00000100:00100000:0.0:1788330107.307795:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788330107.307806:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792337152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330107.308133:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792337152:12345-0@lo:400:kworker.0 Request processed in 329us (3640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330107.308141:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788330107.308258:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792337152:0@lo:400:kworker.0 00010000:00010000:3.0:1788330107.803633:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330108.827603:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788330108.827638:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792338176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330108.827740:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330108.827949:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792338176 00000100:00100000:0.0:1788330108.827961:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792338176 00000100:00100000:0.0:1788330108.828031:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788330108.828043:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792338176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788330108.828081:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330108.828141:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792338176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330108.828178:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:2.0:1788330108.828566:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788330108.828666:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc6604700 x1875199792338176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330108.828692:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6604700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792338176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788330108.828939:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792338304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330108.828990:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330108.829471:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792338304 00000100:00100000:0.0:1788330108.829481:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792338304 00000100:00100000:0.0:1788330108.829533:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788330108.829544:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792338304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788330108.829567:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330108.830317:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792338304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 770us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330108.830328:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1788330108.836898:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc6604e00 x1875199792338304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330108.836932:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792338304:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788330109.719445:0:11999:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 02:21:47 (1788330107) === 00010000:00010000:3.0:1788330109.851325:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330109.855112:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330109.857363:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792338432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330109.857482:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330109.861070:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792338432 00000100:00100000:1.0:1788330109.861099:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792338432 00000100:00100000:1.0:1788330109.862295:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788330109.862315:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792338432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788330109.862372:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788330109.862500:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792338432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 190us (5017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330109.862508:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788330109.862587:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792338432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330110.027946:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330110.028109:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766047744 00000100:00100000:3.0:1788330110.028126:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766047744 00000100:00100000:3.0:1788330110.028276:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 291 00000100:00100000:3.0:1788330110.028289:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+10:8738:x1875199766047744:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788330110.028312:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330110.028739:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef59ca400/0x8475908e9fd0fa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105d2a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330110.028788:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef59ca400/0x8475908e9fd0fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d2a expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330110.028805:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef59ca400/0x8475908e9fd0fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d2a expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330110.029130:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59ca400, rc 0) 00000100:00100000:3.0:1788330110.031659:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+11:8738:x1875199766047744:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 3357us (3712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330110.031682:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 291 00000100:00100000:0.0:1788330110.047672:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330110.047780:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766047872 00000100:00100000:1.0:1788330110.047797:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766047872 00000100:00100000:1.0:1788330110.047864:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 292 00000100:00100000:1.0:1788330110.047884:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+11:8738:x1875199766047872:12345-192.168.202.50@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788330110.048101:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+11:8738:x1875199766047872:12345-192.168.202.50@tcp:501:mount.lustre.0 Request processed in 226us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330110.048110:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 292 00000100:00100000:1.0:1788330110.062603:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330110.062853:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766048000 00000100:00100000:3.0:1788330110.062870:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766048000 00000100:00100000:3.0:1788330110.062962:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 293 00000100:00100000:3.0:1788330110.062976:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+11:8738:x1875199766048000:12345-192.168.202.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788330110.063230:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+11:8738:x1875199766048000:12345-192.168.202.50@tcp:503:mount.lustre.0 Request processed in 255us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330110.063240:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 293 00000100:00100000:3.0:1788330110.069447:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330110.069566:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766048128 00000100:00100000:0.0:1788330110.069595:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766048128 00000100:00100000:0.0:1788330110.069681:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 294 00000100:00100000:0.0:1788330110.069694:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+11:8742:x1875199766048128:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788330110.069936:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+11:8742:x1875199766048128:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 243us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330110.069945:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 294 00000100:00100000:0.0:1788330110.106808:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330110.116050:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766048256 00000100:00100000:1.0:1788330110.116070:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766048256 00000100:00100000:1.0:1788330110.116179:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 295 00000100:00100000:1.0:1788330110.116193:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+11:8742:x1875199766048256:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788330110.117843:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+11:8742:x1875199766048256:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 1640us (11037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330110.117862:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 295 00000100:00100000:1.0:1788330110.131710:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330110.136046:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766048384 00000100:00100000:3.0:1788330110.136068:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766048384 00000100:00100000:0.0:1788330110.136368:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 296 00000100:00100000:0.0:1788330110.136385:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+11:8742:x1875199766048384:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788330110.136629:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+11:8742:x1875199766048384:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 248us (4931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330110.136638:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 296 00000100:00100000:3.0:1788330110.144810:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330110.145085:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766048512 00000100:00100000:1.0:1788330110.145113:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766048512 00000100:00100000:1.0:1788330110.145248:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 297 00000100:00100000:1.0:1788330110.145261:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+11:8738:x1875199766048512:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788330110.145287:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330110.145459:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef6e79800/0x8475908e9fd0fa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105d5b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330110.145504:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e79800/0x8475908e9fd0fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d5b expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330110.145517:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef6e79800/0x8475908e9fd0fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d5b expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330110.145529:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79800, rc 0) 00000100:00100000:1.0:1788330110.146246:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+12:8738:x1875199766048512:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 980us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330110.146267:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 297 00000100:00100000:3.0:1788330110.163618:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330110.163663:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766048640 00000100:00100000:3.0:1788330110.163677:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766048640 00000100:00100000:3.0:1788330110.163752:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 298 00000100:00100000:3.0:1788330110.163765:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+12:8738:x1875199766048640:12345-192.168.202.50@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788330110.163815:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788330110.163835:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788330110.163839:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788330110.163843:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788330110.163847:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788330110.163850:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788330110.175752:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+12:8738:x1875199766048640:12345-192.168.202.50@tcp:256:mount.lustre.0 Request processed in 11971us (12129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330110.175775:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 298 00000100:00100000:1.0:1788330110.187778:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330110.191107:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766048768 00000100:00100000:2.0:1788330110.191140:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766048768 00000100:00100000:2.0:1788330110.191279:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 299 00000100:00100000:2.0:1788330110.191292:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+12:8738:x1875199766048768:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788330110.191316:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330110.191349:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99edc765b800/0x8475908e9fd0fae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105d62 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330110.191389:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99edc765b800/0x8475908e9fd0fae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d62 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330110.191403:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99edc765b800/0x8475908e9fd0fae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d62 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330110.191414:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99edc765b800, rc 0) 00000100:00100000:2.0:1788330110.191520:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+13:8738:x1875199766048768:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 229us (3755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330110.191527:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 299 00000100:00100000:1.0:1788330110.194959:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330110.203202:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766048896 00000100:00100000:3.0:1788330110.203225:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766048896 00000100:00100000:3.0:1788330110.203493:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 300 00000100:00100000:3.0:1788330110.203507:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:8738:x1875199766048896:12345-192.168.202.50@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788330110.203754:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:8738:x1875199766048896:12345-192.168.202.50@tcp:501:mount.lustre.0 Request processed in 250us (8806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330110.203763:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 300 00000100:00100000:1.0:1788330110.209816:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330110.210195:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766049024 00000100:00100000:0.0:1788330110.210211:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766049024 00000100:00100000:0.0:1788330110.210302:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 301 00000100:00100000:0.0:1788330110.210316:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:8738:x1875199766049024:12345-192.168.202.50@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788330110.210511:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:8738:x1875199766049024:12345-192.168.202.50@tcp:503:mount.lustre.0 Request processed in 198us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330110.210520:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 301 00000100:00100000:1.0:1788330110.216568:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330110.216690:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766049152 00000100:00100000:2.0:1788330110.216704:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766049152 00000100:00100000:2.0:1788330110.216779:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 302 00000100:00100000:2.0:1788330110.216793:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+13:8747:x1875199766049152:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788330110.217046:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+13:8747:x1875199766049152:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 254us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330110.217056:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 302 00000100:00100000:1.0:1788330110.226706:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330110.226814:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766049280 00000100:00100000:3.0:1788330110.226826:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766049280 00000100:00100000:3.0:1788330110.226908:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 303 00000100:00100000:3.0:1788330110.226921:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:8747:x1875199766049280:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788330110.227116:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:8747:x1875199766049280:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 195us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330110.227126:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 303 00000100:00100000:0.0:1788330110.251382:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330110.251518:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330110.261541:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330110.269821:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766049536 00000100:00100000:3.0:1788330110.269842:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766049536 00000100:00100000:2.0:1788330110.270521:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766049664 00000100:00100000:2.0:1788330110.270528:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766049664 00000100:00100000:2.0:1788330110.270569:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 131 00000100:00100000:2.0:1788330110.270586:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2412:x1875199766049536:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330110.270709:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2412:x1875199766049536:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 129us (19339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330110.270718:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 131 00000100:00100000:2.0:1788330110.270742:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 132 00000100:00100000:2.0:1788330110.270749:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766049664:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330110.270777:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766049664:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 28us (19259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330110.270784:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 132 00000100:00080000:3.0:1788330110.274419:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788330110.274454:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330110.281213:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330110.281269:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766049408 00000100:00100000:0.0:1788330110.289325:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766049408 00000100:00100000:0.0:1788330110.289406:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766049920 00000100:00100000:0.0:1788330110.289415:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766049920 00000100:00100000:0.0:1788330110.289440:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:0.0:1788330110.289451:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2409:x1875199766049408:12345-192.168.202.50@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788330110.289488:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7ef8caa6-b8a4-4292-af89-d5e39e506906@192.168.202.50@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:0.0:1788330110.289536:0:6522:0:(genops.c:1385:class_connect()) connect: client 7ef8caa6-b8a4-4292-af89-d5e39e506906, cookie 0x8475908e9fd0fb5 00000004:00100000:0.0:1788330110.289573:0:6522:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788330110.289734:0:6522:0:(import.c:65:import_set_state_nolock()) ffff99edc75d6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330110.289845:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2409:x1875199766049408:12345-192.168.202.50@tcp:38:mount.lustre.0 Request processed in 393us (28320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330110.289855:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:0.0:1788330110.289891:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:0.0:1788330110.289896:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2409:x1875199766049920:12345-192.168.202.50@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788330110.289913:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 7ef8caa6-b8a4-4292-af89-d5e39e506906@192.168.202.50@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:0.0:1788330110.289948:0:6522:0:(genops.c:1385:class_connect()) connect: client 7ef8caa6-b8a4-4292-af89-d5e39e506906, cookie 0x8475908e9fd0fbc 00000004:00100000:0.0:1788330110.289965:0:6522:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788330110.290031:0:6522:0:(import.c:65:import_set_state_nolock()) ffff99edc75d1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330110.290056:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2409:x1875199766049920:12345-192.168.202.50@tcp:38:mount.lustre.0 Request processed in 158us (8857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330110.290062:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:2.0:1788330110.293255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330110.294932:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330110.295022:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766049792 00000100:00100000:2.0:1788330110.295032:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766049792 00000100:00100000:2.0:1788330110.295098:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766050176 00000100:00100000:2.0:1788330110.295101:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766050176 00000100:00100000:2.0:1788330110.295114:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:2.0:1788330110.295123:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+7:0:x1875199766049792:12345-192.168.202.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788330110.295198:0:6523:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788330110.295282:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+7:0:x1875199766049792:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 159us (2041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330110.295319:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:2.0:1788330110.295338:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:2.0:1788330110.295344:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:8738:x1875199766050176:12345-192.168.202.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788330110.295354:0:6523:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788330110.295374:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:8738:x1875199766050176:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 30us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330110.295381:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00080000:3.0:1788330110.295886:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330110.300748:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330110.300789:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330110.300891:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766050304 00000100:00100000:1.0:1788330110.300901:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766050304 00000100:00100000:1.0:1788330110.300950:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766050048 00000100:00100000:1.0:1788330110.300953:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766050048 00000100:00080000:1.0:1788330110.300974:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788330110.300995:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:1.0:1788330110.301004:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:8738:x1875199766050304:12345-192.168.202.50@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788330110.301100:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:8738:x1875199766050304:12345-192.168.202.50@tcp:40:mount.lustre.0 Request processed in 96us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330110.301108:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:1.0:1788330110.301259:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:1.0:1788330110.301266:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:0:x1875199766050048:12345-192.168.202.50@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788330110.301287:0:6524:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788330110.301339:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:0:x1875199766050048:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 73us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330110.301345:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:2.0:1788330110.306737:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330110.306784:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330110.306879:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766050432 00000100:00100000:0.0:1788330110.306889:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766050432 00000100:00100000:0.0:1788330110.306928:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766050560 00000100:00100000:0.0:1788330110.306930:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766050560 00000100:00100000:0.0:1788330110.306950:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:0.0:1788330110.306959:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2409:x1875199766050432:12345-192.168.202.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788330110.307007:0:8437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7ef8caa6-b8a4-4292-af89-d5e39e506906@192.168.202.50@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:0.0:1788330110.307040:0:8437:0:(genops.c:1385:class_connect()) connect: client 7ef8caa6-b8a4-4292-af89-d5e39e506906, cookie 0x8475908e9fd0fc3 00002000:00100000:0.0:1788330110.307053:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7ef8caa6-b8a4-4292-af89-d5e39e506906/ffff99edc75d2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788330110.307071:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788330110.307195:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788330110.307221:0:8437:0:(import.c:65:import_set_state_nolock()) ffff99edc75d0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330110.307282:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2409:x1875199766050432:12345-192.168.202.50@tcp:8:mount.lustre.0 Request processed in 323us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330110.307290:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:0.0:1788330110.307307:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:0.0:1788330110.307311:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2409:x1875199766050560:12345-192.168.202.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788330110.307326:0:8437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7ef8caa6-b8a4-4292-af89-d5e39e506906@192.168.202.50@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:0.0:1788330110.307341:0:8437:0:(genops.c:1385:class_connect()) connect: client 7ef8caa6-b8a4-4292-af89-d5e39e506906, cookie 0x8475908e9fd0fca 00002000:00100000:0.0:1788330110.307345:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7ef8caa6-b8a4-4292-af89-d5e39e506906/ffff99edc75d3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788330110.307355:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788330110.307385:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788330110.307397:0:8437:0:(import.c:65:import_set_state_nolock()) ffff99edc75d7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330110.307418:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2409:x1875199766050560:12345-192.168.202.50@tcp:8:mount.lustre.0 Request processed in 105us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330110.307424:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:1.0:1788330110.311244:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330110.311286:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330110.311320:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330110.311642:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766050944 00000100:00100000:3.0:1788330110.311652:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766050944 00000100:00100000:3.0:1788330110.311697:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766051072 00000100:00100000:3.0:1788330110.311699:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766051072 00000100:00100000:3.0:1788330110.311717:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 133 00000100:00100000:3.0:1788330110.311726:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2411:x1875199766050944:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330110.311796:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2411:x1875199766050944:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 71us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330110.311804:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 133 00000100:00100000:3.0:1788330110.311819:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 134 00000100:00100000:3.0:1788330110.311825:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766051072:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330110.311861:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766051072:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 35us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330110.311867:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 134 00000100:00100000:1.0:1788330110.313885:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330110.314799:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766050816 00000100:00100000:0.0:1788330110.314808:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766050816 00000100:00100000:0.0:1788330110.314874:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 304 00000100:00100000:0.0:1788330110.314884:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2411:x1875199766050816:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330110.314966:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2411:x1875199766050816:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 84us (3679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330110.314974:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 304 00000100:00100000:3.0:1788330110.316850:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766050688 00000100:00100000:3.0:1788330110.316862:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766050688 00000100:00100000:3.0:1788330110.316924:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:3.0:1788330110.316933:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:8738:x1875199766050688:12345-192.168.202.50@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788330110.317012:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:8738:x1875199766050688:12345-192.168.202.50@tcp:900:mount.lustre.0 Request processed in 80us (3531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330110.317019:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:0.0:1788330110.322093:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330110.322198:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766051200 00000100:00100000:3.0:1788330110.322207:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766051200 00000100:00100000:3.0:1788330110.322313:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:3.0:1788330110.322351:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:8738:x1875199766051200:12345-192.168.202.50@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788330110.322435:0:6525:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788330110.322711:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:8738:x1875199766051200:12345-192.168.202.50@tcp:33:mount.lustre.0 Request processed in 370us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330110.322718:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 1 00010000:00010000:3.0:1788330110.875947:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330111.899404:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330112.411346:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792338560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330112.411420:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330112.411511:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792338560 00000100:00100000:0.0:1788330112.411520:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792338560 00000100:00100000:0.0:1788330112.411573:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788330112.411582:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee75f0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792338560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330112.411613:0:7831:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788330112.411654:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee75f0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792338560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330112.411662:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788330112.412015:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792338560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330112.412467:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7cfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792338688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330112.412498:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330112.417291:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792338688 00000100:00100000:3.0:1788330112.417305:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792338688 00000100:00100000:3.0:1788330112.417371:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788330112.417383:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792338688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788330112.417411:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330112.417505:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792338688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (5005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330112.417512:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788330112.417534:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788330112.417581:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7cfce00 x1875199792338688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330112.417600:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7cfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792338688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330112.417837:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792338944:0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.417877:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330112.417909:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792339456:0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.417926:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330112.417945:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792339968:0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.417962:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330112.417977:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788330112.417998:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792338816:0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.418025:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330112.418044:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792339328:0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.418060:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330112.418072:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792339840:0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.418087:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330112.418105:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792338944 00000100:00100000:0.0:1788330112.418109:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792338944 00000100:00100000:0.0:1788330112.418142:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792339456 00000100:00100000:0.0:1788330112.418145:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792339456 00000100:00100000:0.0:1788330112.418174:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792339968 00000100:00100000:0.0:1788330112.418177:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792339968 00000100:00100000:0.0:1788330112.418199:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792339328 00000100:00100000:0.0:1788330112.418202:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792339328 00000100:00100000:0.0:1788330112.418212:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792339840 00000100:00100000:0.0:1788330112.418215:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792339840 00000100:00100000:0.0:1788330112.418226:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788330112.418232:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792338944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.418267:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792338944:12345-0@lo:400:kworker.0 Request processed in 35us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330112.418273:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788330112.418286:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788330112.418292:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792339456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.418312:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792339456:12345-0@lo:400:kworker.0 Request processed in 21us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330112.418318:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788330112.418327:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788330112.418332:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792339968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.418360:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792339968:12345-0@lo:400:kworker.0 Request processed in 28us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330112.418366:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788330112.418376:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788330112.418380:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792339328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.418400:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792339328:12345-0@lo:400:kworker.0 Request processed in 20us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330112.418405:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788330112.418413:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788330112.418418:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792339840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.418437:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792339840:12345-0@lo:400:kworker.0 Request processed in 19us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330112.418442:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788330112.418457:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792338816 00000100:00100000:0.0:1788330112.418460:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792338816 00000100:00100000:0.0:1788330112.418481:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788330112.418486:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792338816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.418509:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792338816:12345-0@lo:400:kworker.0 Request processed in 24us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330112.418515:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00080000:3.0:1788330112.421125:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788330112.421133:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788330112.421180:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792339200:0@lo:400:kworker.0 00000100:00100000:3.0:1788330112.421245:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330112.421282:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792339712:0@lo:400:kworker.0 00000100:00100000:3.0:1788330112.421305:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330112.421322:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792340224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330112.421358:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330112.421394:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792339712 00000100:00100000:3.0:1788330112.421401:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792339712 00000100:00100000:3.0:1788330112.421445:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788330112.421454:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792339712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330112.421497:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792339712:12345-0@lo:400:kworker.0 Request processed in 44us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330112.421504:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788330112.421523:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792340224 00000100:00100000:3.0:1788330112.421526:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792340224 00000100:00100000:3.0:1788330112.422334:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788330112.422343:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792340224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330112.422360:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330112.422397:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792340224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330112.422403:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788330112.422421:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330112.422425:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788330112.422450:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefd32ea00 x1875199792339712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330112.422464:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792339712:0@lo:400:kworker.0 00010000:00080000:3.0:1788330112.422473:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcf8380 x1875199792340224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330112.422485:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792340224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330112.423739:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792339072:0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.423799:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330112.423833:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792339584:0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.423854:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330112.423875:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792340096:0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.423906:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330112.423950:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792339584 00000100:00100000:0.0:1788330112.423956:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792339584 00000100:00100000:0.0:1788330112.423993:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792340096 00000100:00100000:0.0:1788330112.423995:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792340096 00000100:00100000:0.0:1788330112.424009:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788330112.424015:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792339584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.424052:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792339584:12345-0@lo:400:kworker.0 Request processed in 38us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330112.424058:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788330112.424071:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788330112.424076:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792340096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.424097:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792340096:12345-0@lo:400:kworker.0 Request processed in 22us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330112.424103:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788330112.424644:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792339200 00000100:00100000:2.0:1788330112.424649:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792339200 00000100:00100000:2.0:1788330112.424679:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788330112.424686:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792339200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330112.424724:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792339200:12345-0@lo:400:kworker.0 Request processed in 39us (3479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330112.424730:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00010000:00080000:2.0:1788330112.425228:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefd32dc00 x1875199792339584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330112.425241:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792339584:0@lo:400:kworker.0 00010000:00080000:2.0:1788330112.425252:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6fe6680 x1875199792340096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330112.425275:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792340096:0@lo:400:kworker.0 00000100:00100000:3.0:1788330112.425463:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792339072 00000100:00100000:3.0:1788330112.425468:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792339072 00000100:00100000:3.0:1788330112.425512:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788330112.425519:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792339072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330112.425575:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792339072:12345-0@lo:400:kworker.0 Request processed in 57us (1775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330112.425581:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1788330112.425600:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330112.425625:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792339200:0@lo:400:kworker.0 00000100:00100000:3.0:1788330112.425647:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792339072:0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.426299:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792338816:0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.426322:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792339328:0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.426333:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792339840:0@lo:400:kworker.0 00000100:00100000:0.0:1788330112.426343:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792338944:0@lo:400:kworker.0 00010000:00080000:0.0:1788330112.426355:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefd32fb80 x1875199792339456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330112.426367:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792339456:0@lo:400:kworker.0 00010000:00080000:0.0:1788330112.426378:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6fe7800 x1875199792339968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330112.426400:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792339968:0@lo:400:kworker.0 00010000:00010000:3.0:1788330112.924569:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330113.947471:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792340352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330113.947555:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330113.947905:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792340352 00000100:00100000:1.0:1788330113.947914:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792340352 00000100:00100000:1.0:1788330113.947981:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788330113.947993:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792340352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788330113.948025:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330113.948086:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792340352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330113.948093:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1788330113.948238:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fc000 x1875199792340352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330113.948260:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792340352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330113.948278:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330113.948284:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792340480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330113.948310:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330113.948389:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792340480 00000100:00100000:0.0:1788330113.948394:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792340480 00000100:00100000:0.0:1788330113.948426:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788330113.948434:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792340480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788330113.948445:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330113.948488:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792340480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330113.948494:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1788330113.948559:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefe7e8380 x1875199792340480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330113.948572:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792340480:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788330113.949041:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330114.971472:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792340608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330114.971548:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330114.971735:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792340608 00000100:00100000:1.0:1788330114.971745:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792340608 00000100:00100000:1.0:1788330114.971819:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788330114.971830:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792340608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788330114.971896:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00010000:00010000:2.0:1788330114.972400:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330114.979005:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792340608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7164us (7445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330114.979020:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788330114.979206:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792340608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330115.812060:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330115.812293:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330115.812384:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330115.814393:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766051328 00000100:00100000:2.0:1788330115.814408:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766051328 00000100:00100000:2.0:1788330115.814475:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 306 00000100:00100000:2.0:1788330115.814485:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2411:x1875199766051328:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330115.814571:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2411:x1875199766051328:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 88us (2528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330115.814579:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 306 00000100:00100000:3.0:1788330115.818309:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330115.818340:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330115.818404:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766052096 00000100:00100000:1.0:1788330115.818415:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766052096 00000100:00100000:1.0:1788330115.818481:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 56 00000100:00100000:1.0:1788330115.818493:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2411:x1875199766052096:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330115.818573:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2411:x1875199766052096:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 83us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330115.818580:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 56 00000100:00100000:0.0:1788330115.822178:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766051584 00000100:00100000:0.0:1788330115.822197:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766051584 00000100:00100000:0.0:1788330115.822300:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766051840 00000100:00100000:0.0:1788330115.822304:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766051840 00000100:00100000:0.0:1788330115.822350:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 141 00000100:00100000:0.0:1788330115.822362:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766051584:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330115.822452:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766051584:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 92us (10159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330115.822460:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 141 00000100:00100000:0.0:1788330115.822480:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 142 00000100:00100000:0.0:1788330115.822487:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2411:x1875199766051840:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330115.822511:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2411:x1875199766051840:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 25us (10128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330115.822517:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 142 00000100:00080000:0.0:1788330115.822597:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788330115.822619:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330115.823644:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330115.823679:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330115.824988:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766051456 00000100:00100000:1.0:1788330115.825002:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766051456 00000100:00100000:1.0:1788330115.825075:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766051712 00000100:00100000:1.0:1788330115.825088:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766051712 00000100:00100000:1.0:1788330115.825123:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 143 00000100:00100000:1.0:1788330115.825134:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2411:x1875199766051456:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330115.825227:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2411:x1875199766051456:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 96us (6885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330115.825235:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 143 00000100:00100000:1.0:1788330115.825593:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 144 00000100:00100000:1.0:1788330115.825602:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2411:x1875199766051712:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330115.825633:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2411:x1875199766051712:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 32us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330115.825639:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 144 00000100:00080000:1.0:1788330115.825679:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330115.830544:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766051968 00000100:00100000:3.0:1788330115.830567:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766051968 00000100:00080000:1.0:1788330115.831862:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330115.833413:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00100000:3.0:1788330115.833441:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2411:x1875199766051968:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330115.833537:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2411:x1875199766051968:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 112us (9856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330115.833545:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 57 00010000:00010000:0.0:1788330116.001727:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788330116.004968:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7ef8caa6-b8a4-4292-af89-d5e39e506906 00000001:00100000:3.0:1788330116.005767:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7ef8caa6-b8a4-4292-af89-d5e39e506906 00000001:00100000:2.0:1788330116.007238:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7ef8caa6-b8a4-4292-af89-d5e39e506906 00000001:00100000:2.0:1788330116.007839:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7ef8caa6-b8a4-4292-af89-d5e39e506906 00000001:02000400:1.0:1788330116.807025:0:12192:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1788330117.023542:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330117.531697:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792341120:0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.531808:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330117.531907:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792341632:0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.531939:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330117.531969:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792342144:0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.531993:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330117.532027:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788330117.532033:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792340736:0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.532112:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330117.532138:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792341248:0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.532203:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330117.532223:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792341760:0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.532266:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330117.532286:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792342272:0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.532309:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330117.532341:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792340992:0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.532368:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330117.532385:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792341504:0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.532407:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330117.532422:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792342016:0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.532442:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330117.532463:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788330117.532470:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792340864:0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.532493:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330117.532509:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792341376:0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.532532:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330117.532543:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792341888:0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.532561:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330117.532588:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792341632 00000100:00100000:2.0:1788330117.532600:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792341632 00000100:00100000:2.0:1788330117.532660:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792342144 00000100:00100000:2.0:1788330117.532663:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792342144 00000100:00100000:2.0:1788330117.532679:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792341760 00000100:00100000:2.0:1788330117.532682:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792341760 00000100:00100000:2.0:1788330117.532697:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792342272 00000100:00100000:2.0:1788330117.532699:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792342272 00000100:00100000:2.0:1788330117.532715:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788330117.532725:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792341632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.532801:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792341632:12345-0@lo:400:kworker.0 Request processed in 76us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330117.532809:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788330117.532831:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788330117.532838:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792342144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.532868:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792342144:12345-0@lo:400:kworker.0 Request processed in 31us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330117.532873:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788330117.532885:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788330117.532891:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792341760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.532920:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792341760:12345-0@lo:400:kworker.0 Request processed in 30us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330117.532926:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788330117.532936:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788330117.532943:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792342272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.532969:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792342272:12345-0@lo:400:kworker.0 Request processed in 27us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330117.532975:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788330117.533001:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792340736 00000100:00100000:2.0:1788330117.533006:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792340736 00000100:00100000:2.0:1788330117.533034:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788330117.533041:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3648:x1875199792340736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.533088:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3648:x1875199792340736:12345-0@lo:400:kworker.0 Request processed in 48us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330117.533094:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788330117.533133:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792341248 00000100:00100000:2.0:1788330117.533137:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792341248 00000100:00100000:2.0:1788330117.533190:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792340992 00000100:00100000:2.0:1788330117.533194:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792340992 00000100:00100000:2.0:1788330117.533209:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788330117.533216:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792341248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.533265:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792341248:12345-0@lo:400:kworker.0 Request processed in 49us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330117.533271:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788330117.533284:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788330117.533290:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792340992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.533327:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792340992:12345-0@lo:400:kworker.0 Request processed in 37us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330117.533333:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788330117.533364:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792341120 00000100:00100000:2.0:1788330117.533369:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792341120 00000100:00100000:2.0:1788330117.533389:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792341504 00000100:00100000:2.0:1788330117.533392:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792341504 00000100:00100000:2.0:1788330117.533406:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792342016 00000100:00100000:2.0:1788330117.533409:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792342016 00000100:00100000:2.0:1788330117.533420:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792340864 00000100:00100000:2.0:1788330117.533422:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792340864 00000100:00100000:2.0:1788330117.533430:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792341376 00000100:00100000:2.0:1788330117.533433:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792341376 00000100:00100000:2.0:1788330117.533445:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792341888 00000100:00100000:2.0:1788330117.533448:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792341888 00000100:00100000:2.0:1788330117.533463:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788330117.533469:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792341120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.533504:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792341120:12345-0@lo:400:kworker.0 Request processed in 35us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330117.533520:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788330117.533532:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788330117.533538:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792341504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.533570:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792341504:12345-0@lo:400:kworker.0 Request processed in 33us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330117.533576:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788330117.533586:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788330117.533592:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792342016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.533619:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792342016:12345-0@lo:400:kworker.0 Request processed in 28us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330117.533624:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788330117.533634:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788330117.533639:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792340864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.533662:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792340864:12345-0@lo:400:kworker.0 Request processed in 22us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330117.533667:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788330117.533675:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788330117.533679:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792341376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.533700:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792341376:12345-0@lo:400:kworker.0 Request processed in 20us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330117.533705:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788330117.533715:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788330117.533720:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792341888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.533744:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792341888:12345-0@lo:400:kworker.0 Request processed in 24us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330117.533756:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788330117.533808:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792340864:0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.533819:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792341376:0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.533828:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792341888:0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.533839:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792340992:0@lo:400:kworker.0 00010000:00080000:2.0:1788330117.533852:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef58ca680 x1875199792341504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330117.533863:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792341504:0@lo:400:kworker.0 00010000:00080000:2.0:1788330117.533873:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef58cad80 x1875199792342016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330117.533881:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792342016:0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.533924:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792340736:0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.533936:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792341248:0@lo:400:kworker.0 00010000:00080000:2.0:1788330117.533948:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef58cb800 x1875199792341760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330117.533956:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792341760:0@lo:400:kworker.0 00010000:00080000:2.0:1788330117.533964:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eee7640700 x1875199792342272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330117.533971:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792342272:0@lo:400:kworker.0 00000100:00100000:2.0:1788330117.533980:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792341120:0@lo:400:kworker.0 00010000:00080000:2.0:1788330117.534000:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef58c8700 x1875199792341632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330117.534007:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792341632:0@lo:400:kworker.0 00010000:00080000:2.0:1788330117.534018:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef58c8380 x1875199792342144/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330117.534026:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792342144:0@lo:400:kworker.0 00000100:00080000:1.0:1788330117.534633:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788330117.534641:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788330117.534646:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788330117.534648:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330117.534849:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792342400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330117.534927:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330117.534988:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792342400 00000100:00100000:3.0:1788330117.534995:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792342400 00000100:00100000:3.0:1788330117.535041:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788330117.535051:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792342400:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330117.535350:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330117.535359:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792342528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788330117.535398:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330117.535433:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792342528 00000100:00100000:1.0:1788330117.535438:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792342528 00000100:00100000:1.0:1788330117.535474:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788330117.535482:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792342528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788330117.535508:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330117.535555:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792342528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330117.535563:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1788330117.535604:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fdf80 x1875199792342528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330133 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330117.535624:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792342528:0@lo:13:osp-pre-1-1.0 00000004:00000024:3.0:1788330117.535725:0:7831:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788330117.535771:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792342400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 722us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330117.535791:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788330117.536615:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792342400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330117.540680:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792342656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330117.540798:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330117.540929:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792342656 00000100:00100000:1.0:1788330117.540941:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792342656 00000100:00100000:1.0:1788330117.541022:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788330117.541037:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792342656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330117.541080:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330117.550605:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792342656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9556us (9791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330117.550625:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1788330117.555657:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc5eea680 x1875199792342656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330133 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330117.555699:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792342656:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788330118.045398:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330119.069144:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330119.069298:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792342784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330119.069399:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330119.069502:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792342912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330119.069535:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330119.069584:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792342784 00000100:00100000:3.0:1788330119.069594:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792342784 00000100:00100000:3.0:1788330119.069658:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792342912 00000100:00100000:3.0:1788330119.069661:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792342912 00000100:00100000:3.0:1788330119.069683:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788330119.069695:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef7068050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792342784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330119.069735:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330119.069787:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef7068050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792342784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330119.069795:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788330119.070078:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788330119.070086:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792342912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788330119.070096:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330119.070129:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792342912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330119.070136:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1788330119.070186:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788330119.070227:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefd32ea00 x1875199792342912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330119.070249:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792342912:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788330119.070295:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefd32dc00 x1875199792342784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330119.070307:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792342784:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788330120.091502:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330120.092654:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330120.102687:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792343040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330120.102798:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330120.103399:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792343040 00000100:00100000:1.0:1788330120.103411:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792343040 00000100:00100000:1.0:1788330120.103480:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788330120.103492:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792343040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788330120.103543:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788330120.103611:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792343040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330120.103620:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788330120.109062:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792343040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330120.945652:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330120.945700:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330120.945733:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330120.945767:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330120.945789:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330120.945812:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330120.945838:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330120.945872:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766052352 00000100:00100000:1.0:1788330120.945885:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766052352 00000100:00100000:1.0:1788330120.945955:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766052608 00000100:00100000:1.0:1788330120.945959:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766052608 00000100:00100000:1.0:1788330120.945975:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766052480 00000100:00100000:1.0:1788330120.945978:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766052480 00000100:00100000:1.0:1788330120.945992:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766052736 00000100:00100000:1.0:1788330120.945994:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766052736 00000100:00100000:1.0:1788330120.946013:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 151 00000100:00100000:1.0:1788330120.946027:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2413:x1875199766052352:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330120.946141:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2413:x1875199766052352:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 116us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330120.946190:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 151 00000100:00100000:1.0:1788330120.946212:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 152 00000100:00100000:1.0:1788330120.946218:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766052608:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330120.946245:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766052608:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 28us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330120.946251:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 152 00000100:00100000:1.0:1788330120.946264:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 153 00000100:00100000:1.0:1788330120.946271:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766052480:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330120.946291:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766052480:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 21us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330120.946297:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 153 00000100:00100000:1.0:1788330120.946307:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 154 00000100:00100000:1.0:1788330120.946313:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766052736:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330120.946332:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766052736:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 19us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330120.946337:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 154 00000100:00100000:1.0:1788330120.946357:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766052864 00000100:00100000:1.0:1788330120.946361:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766052864 00000100:00100000:1.0:1788330120.946386:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766052992 00000100:00100000:1.0:1788330120.946389:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766052992 00000100:00100000:1.0:1788330120.946405:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 62 00000100:00100000:1.0:1788330120.946411:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766052864:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330120.946435:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766052864:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 24us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330120.946448:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 62 00000100:00100000:1.0:1788330120.946460:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:1.0:1788330120.946466:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766052992:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330120.946492:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766052992:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 27us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330120.946499:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:1.0:1788330120.946519:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766052224 00000100:00100000:1.0:1788330120.946524:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766052224 00000100:00100000:1.0:1788330120.946551:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 308 00000100:00100000:1.0:1788330120.946558:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2413:x1875199766052224:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330120.946584:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2413:x1875199766052224:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 27us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330120.946591:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 308 00000100:00080000:1.0:1788330120.946637:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788330120.946642:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788330120.946645:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788330120.946647:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788330121.116186:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330122.155052:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330122.653316:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792343168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330122.653430:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330122.653529:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792343168 00000100:00100000:1.0:1788330122.653539:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792343168 00000100:00100000:1.0:1788330122.653600:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788330122.653610:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792343168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788330122.653652:0:7831:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788330122.653702:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792343168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330122.653725:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788330122.653781:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792343168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330122.654465:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330122.654478:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792343296:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330122.654526:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330122.654573:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792343296 00000100:00100000:2.0:1788330122.654579:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792343296 00000100:00100000:2.0:1788330122.654629:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788330122.654638:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792343296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788330122.654664:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330122.654703:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792343296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330122.654709:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788330122.654732:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788330122.654760:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc5ee9500 x1875199792343296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330122.654777:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792343296:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330122.658817:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788330122.658849:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792343424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330122.658965:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330122.659046:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792343424 00000100:00100000:2.0:1788330122.659064:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792343424 00000100:00100000:2.0:1788330122.659133:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788330122.659145:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792343424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788330122.659240:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330122.659296:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792343424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330122.659306:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788330122.659332:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788330122.659368:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc5ee9500 x1875199792343424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330122.659390:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792343424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330122.659893:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792343808:0@lo:400:kworker.0 00000100:00100000:1.0:1788330122.659947:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330122.659971:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792344320:0@lo:400:kworker.0 00000100:00100000:1.0:1788330122.659998:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330122.660037:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788330122.660043:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792343680:0@lo:400:kworker.0 00000100:00100000:1.0:1788330122.660079:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330122.660098:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792344192:0@lo:400:kworker.0 00000100:00100000:1.0:1788330122.660120:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330122.660136:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792344704:0@lo:400:kworker.0 00000100:00100000:1.0:1788330122.660181:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330122.660210:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792344320 00000100:00100000:1.0:1788330122.660217:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792344320 00000100:00100000:1.0:1788330122.660263:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788330122.660272:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792344320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330122.660314:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792344320:12345-0@lo:400:kworker.0 Request processed in 44us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330122.660321:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788330122.660345:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792343680 00000100:00100000:1.0:1788330122.660349:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792343680 00000100:00100000:1.0:1788330122.660374:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792344192 00000100:00100000:1.0:1788330122.660377:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792344192 00000100:00100000:1.0:1788330122.660391:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792344704 00000100:00100000:1.0:1788330122.660403:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792344704 00000100:00100000:1.0:1788330122.660428:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788330122.660434:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792343680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330122.660467:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792343680:12345-0@lo:400:kworker.0 Request processed in 32us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330122.660474:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788330122.660486:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788330122.660493:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792344192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330122.660519:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792344192:12345-0@lo:400:kworker.0 Request processed in 27us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330122.660525:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788330122.660537:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788330122.660543:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875199792344704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330122.660570:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875199792344704:12345-0@lo:400:kworker.0 Request processed in 27us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330122.660575:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788330122.660620:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792343680:0@lo:400:kworker.0 00010000:00080000:1.0:1788330122.660634:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc730f800 x1875199792344192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330122.660645:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792344192:0@lo:400:kworker.0 00010000:00080000:1.0:1788330122.660654:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc730ce00 x1875199792344704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330122.660662:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792344704:0@lo:400:kworker.0 00010000:00080000:1.0:1788330122.660672:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc730d180 x1875199792344320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330122.660686:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792344320:0@lo:400:kworker.0 00000100:00100000:0.0:1788330122.660976:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792343936:0@lo:400:kworker.0 00000100:00100000:0.0:1788330122.661021:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330122.661058:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792344448:0@lo:400:kworker.0 00000100:00100000:0.0:1788330122.661083:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330122.661108:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788330122.661114:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792343552:0@lo:400:kworker.0 00000100:00100000:0.0:1788330122.661147:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330122.661310:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792344064:0@lo:400:kworker.0 00000100:00100000:0.0:1788330122.661336:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330122.661354:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792344576:0@lo:400:kworker.0 00000100:00100000:0.0:1788330122.661374:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330122.661404:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792343808 00000100:00100000:0.0:1788330122.661409:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792343808 00000100:00100000:0.0:1788330122.661456:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788330122.661463:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792343808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330122.661512:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792343808:12345-0@lo:400:kworker.0 Request processed in 49us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330122.661519:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788330122.661548:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792344448 00000100:00100000:0.0:1788330122.661553:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792344448 00000100:00100000:0.0:1788330122.661584:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788330122.661590:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792344448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330122.661626:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792344448:12345-0@lo:400:kworker.0 Request processed in 36us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330122.661632:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788330122.661863:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792343936 00000100:00100000:1.0:1788330122.661868:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792343936 00000100:00100000:1.0:1788330122.661889:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792344064 00000100:00100000:1.0:1788330122.661892:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792344064 00000100:00100000:1.0:1788330122.661905:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792344576 00000100:00100000:1.0:1788330122.661908:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792344576 00000100:00100000:1.0:1788330122.661932:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788330122.661939:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792343936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330122.661973:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792343936:12345-0@lo:400:kworker.0 Request processed in 34us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330122.661978:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788330122.661989:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788330122.661994:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792344064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330122.662024:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792344064:12345-0@lo:400:kworker.0 Request processed in 20us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330122.662030:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788330122.662040:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788330122.662045:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792344576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330122.662074:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792344576:12345-0@lo:400:kworker.0 Request processed in 29us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330122.662079:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788330122.662437:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792343552 00000100:00100000:2.0:1788330122.662443:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792343552 00000100:00100000:2.0:1788330122.662477:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788330122.662484:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3646:x1875199792343552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330122.662521:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3646:x1875199792343552:12345-0@lo:400:kworker.0 Request processed in 38us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330122.662527:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:2.0:1788330122.662557:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788330122.662562:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788330122.662566:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330122.664291:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792343808:0@lo:400:kworker.0 00000100:00100000:1.0:1788330122.666350:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792343552:0@lo:400:kworker.0 00000100:00100000:1.0:1788330122.666393:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792344064:0@lo:400:kworker.0 00000100:00100000:1.0:1788330122.666409:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792344576:0@lo:400:kworker.0 00000100:00100000:1.0:1788330122.666424:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792343936:0@lo:400:kworker.0 00010000:00080000:1.0:1788330122.666441:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc730d880 x1875199792344448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330122.666453:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792344448:0@lo:400:kworker.0 00010000:00010000:0.0:1788330123.168948:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330124.187651:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330124.187688:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792344832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330124.187790:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330124.187881:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792344832 00000100:00100000:3.0:1788330124.187891:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792344832 00000100:00100000:3.0:1788330124.187963:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788330124.187976:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792344832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330124.188029:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330124.188087:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792344832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330124.188094:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1788330124.188121:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788330124.188181:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefd32dc00 x1875199792344832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330124.188204:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792344832:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788330124.189520:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330124.190561:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792344960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788330124.190653:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330124.190730:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792344960 00000100:00100000:3.0:1788330124.190742:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792344960 00000100:00080000:2.0:1788330124.190806:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330124.190841:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788330124.190856:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792344960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788330124.190884:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330124.190991:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792344960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330124.191009:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:2.0:1788330124.191697:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99ef00b67100 x1875199792344960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330124.191723:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792344960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330125.211362:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330125.211387:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792345088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330125.211909:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330125.212106:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330125.215442:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792345088 00000100:00100000:1.0:1788330125.215462:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792345088 00000100:00100000:1.0:1788330125.215552:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788330125.215565:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792345088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788330125.215620:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788330125.215814:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792345088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 250us (3910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330125.215822:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788330125.229379:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792345088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330126.071283:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330126.071574:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330126.071610:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766053120 00000100:00100000:1.0:1788330126.071621:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766053120 00000100:00100000:1.0:1788330126.073352:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 310 00000100:00100000:1.0:1788330126.073381:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2413:x1875199766053120:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330126.077106:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2413:x1875199766053120:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 3726us (5819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330126.077124:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 310 00000100:00100000:1.0:1788330126.077215:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766053248 00000100:00100000:1.0:1788330126.077233:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766053248 00000100:00100000:1.0:1788330126.077302:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 161 00000100:00100000:1.0:1788330126.077312:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2413:x1875199766053248:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330126.077380:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2413:x1875199766053248:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 71us (5808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330126.077387:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 161 00000100:00080000:1.0:1788330126.077408:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330126.100435:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330126.100486:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330126.100517:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330126.100546:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330126.100582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330126.100621:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766053760 00000100:00100000:1.0:1788330126.100632:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766053760 00000100:00100000:1.0:1788330126.100716:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766053888 00000100:00100000:1.0:1788330126.100720:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766053888 00000100:00100000:1.0:1788330126.100748:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 66 00000100:00100000:1.0:1788330126.100759:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766053760:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330126.100843:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766053760:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 86us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330126.100850:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 66 00000100:00100000:1.0:1788330126.100868:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00100000:1.0:1788330126.100875:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766053888:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330126.100900:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766053888:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 26us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330126.100907:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00080000:1.0:1788330126.100943:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788330126.100947:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330126.100958:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766053376 00000100:00100000:1.0:1788330126.100962:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766053376 00000100:00100000:1.0:1788330126.101002:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766053504 00000100:00100000:1.0:1788330126.101006:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766053504 00000100:00100000:1.0:1788330126.101232:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766053632 00000100:00100000:1.0:1788330126.101236:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766053632 00000100:00100000:1.0:1788330126.101258:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 162 00000100:00100000:1.0:1788330126.101265:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766053376:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330126.101294:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766053376:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 30us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330126.101301:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 162 00000100:00100000:1.0:1788330126.101314:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 163 00000100:00100000:1.0:1788330126.101321:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766053504:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330126.101347:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766053504:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 27us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330126.101353:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 163 00000100:00100000:1.0:1788330126.101366:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 164 00000100:00100000:1.0:1788330126.101372:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2412:x1875199766053632:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330126.101394:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2412:x1875199766053632:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 22us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330126.101400:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 164 00000100:00080000:1.0:1788330126.101419:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788330126.101423:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788330126.236722:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330127.276693:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788330127.769243:0:12508:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788330127.769670:0:12508:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788330127.771402:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792345216:0@lo:400:kworker.0 00000100:00100000:1.0:1788330127.771506:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330127.771556:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792345728:0@lo:400:kworker.0 00000100:00100000:1.0:1788330127.771580:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330127.771598:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792346240:0@lo:400:kworker.0 00000100:00100000:1.0:1788330127.771619:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330127.771633:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792346752:0@lo:400:kworker.0 00000100:00100000:1.0:1788330127.771653:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330127.771676:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788330127.771681:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99ef00b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792345344:0@lo:400:kworker.0 00000100:00100000:1.0:1788330127.771747:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330127.771765:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792345856:0@lo:400:kworker.0 00000100:00100000:1.0:1788330127.771787:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330127.771802:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792346368:0@lo:400:kworker.0 00000100:00100000:1.0:1788330127.771822:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330127.771840:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792346880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330127.771865:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330127.771904:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792345472:0@lo:400:kworker.0 00000100:00100000:1.0:1788330127.771956:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330127.771994:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792345984:0@lo:400:kworker.0 00000100:00100000:3.0:1788330127.772025:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792345728 00000100:00100000:1.0:1788330127.772025:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330127.772044:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792345728 00000100:00100000:1.0:1788330127.772050:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792346496:0@lo:400:kworker.0 00000100:00100000:1.0:1788330127.772080:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330127.772105:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788330127.772117:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792345600:0@lo:400:kworker.0 00000100:00100000:3.0:1788330127.772118:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792346880 00000100:00100000:3.0:1788330127.772123:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792346880 00000100:00100000:3.0:1788330127.772142:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792345472 00000100:00100000:3.0:1788330127.772147:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792345472 00000100:00100000:1.0:1788330127.772209:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330127.772210:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788330127.772232:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875199792345728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330127.772241:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792346112:0@lo:400:kworker.0 00000100:00100000:1.0:1788330127.772268:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330127.772291:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792346624:0@lo:400:kworker.0 00000100:00100000:1.0:1788330127.772330:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330127.772358:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875199792345728:12345-0@lo:400:kworker.0 Request processed in 130us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330127.772367:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788330127.772387:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788330127.772393:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792346880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788330127.772423:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788330127.772480:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792345216 00000100:00100000:1.0:1788330127.772489:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792345216 00000100:00100000:3.0:1788330127.772510:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792346880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330127.772519:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788330127.772544:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788330127.772552:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788330127.772562:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792345472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330127.772572:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3648:x1875199792345216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330127.773638:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792345344 00000100:00100000:0.0:1788330127.773648:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792345344 00000100:00100000:0.0:1788330127.773678:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792345856 00000100:00100000:0.0:1788330127.773681:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792345856 00000100:00100000:2.0:1788330127.774261:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792346368 00000100:00100000:2.0:1788330127.774267:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792346368 00000100:00100000:0.0:1788330127.774332:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792345984 00000100:00100000:0.0:1788330127.774336:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792345984 00000100:00100000:1.0:1788330127.774433:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3648:x1875199792345216:12345-0@lo:400:kworker.0 Request processed in 1859us (2933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330127.774446:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788330127.774513:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792346240 00000100:00100000:1.0:1788330127.774518:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792346240 00000100:00100000:3.0:1788330127.774622:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792345472:12345-0@lo:400:kworker.0 Request processed in 2061us (2657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330127.774637:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788330127.774652:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792346496 00000100:00100000:2.0:1788330127.774658:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792346496 00000100:00100000:2.0:1788330127.774714:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792345600 00000100:00100000:2.0:1788330127.774718:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792345600 00000100:00100000:2.0:1788330127.774747:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788330127.774759:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792345344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330127.774783:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792345472:0@lo:400:kworker.0 00000100:00100000:3.0:1788330127.774844:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792345344:0@lo:400:kworker.0 00000100:00100000:2.0:1788330127.775833:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792345344:12345-0@lo:400:kworker.0 Request processed in 1072us (4079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330127.775843:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788330127.775869:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788330127.775878:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792345856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330127.775926:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792345856:12345-0@lo:400:kworker.0 Request processed in 51us (4139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330127.775933:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788330127.775945:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788330127.775952:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792346368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330127.775993:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792346368:12345-0@lo:400:kworker.0 Request processed in 41us (4169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330127.775999:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788330127.776014:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788330127.776020:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792346496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330127.776088:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792346496:12345-0@lo:400:kworker.0 Request processed in 67us (4006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330127.776094:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788330127.776107:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788330127.776114:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792345600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330127.776144:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792345600:12345-0@lo:400:kworker.0 Request processed in 31us (3949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330127.776165:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788330127.776256:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792347136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330127.776340:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330127.776370:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788330127.776376:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792347008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330127.776397:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330127.776424:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792347136 00000100:00100000:2.0:1788330127.776431:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792347136 00000100:00100000:2.0:1788330127.776466:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792347008 00000100:00100000:2.0:1788330127.776468:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792347008 00000100:00100000:2.0:1788330127.776481:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788330127.776487:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792347136:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330127.776857:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788330127.776867:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792345984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330127.776908:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792345984:12345-0@lo:400:kworker.0 Request processed in 44us (4886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330127.776916:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788330127.776942:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792346752 00000100:00100000:0.0:1788330127.776956:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792346752 00000100:00100000:0.0:1788330127.776989:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792346112 00000100:00100000:0.0:1788330127.776992:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792346112 00000100:00100000:0.0:1788330127.777008:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792346624 00000100:00100000:0.0:1788330127.777010:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792346624 00000100:00100000:0.0:1788330127.777023:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788330127.777028:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1875199792346752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330127.777062:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1875199792346752:12345-0@lo:400:kworker.0 Request processed in 33us (5407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330127.777067:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788330127.777078:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788330127.777086:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792346112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330127.777119:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792346112:12345-0@lo:400:kworker.0 Request processed in 35us (4851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330127.777125:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788330127.777136:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788330127.777142:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3646:x1875199792346624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330127.777194:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3646:x1875199792346624:12345-0@lo:400:kworker.0 Request processed in 53us (4863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330127.777200:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1788330127.777221:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330127.777226:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788330127.777229:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788330127.777232:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330127.777518:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792346880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330127.777538:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99ef00b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792345216:0@lo:400:kworker.0 00000100:00100000:3.0:1788330127.777550:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792345728:0@lo:400:kworker.0 00010000:00080000:3.0:1788330127.777568:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6ea2a00 x1875199792346752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330127.777579:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792346752:0@lo:400:kworker.0 00000100:00100000:3.0:1788330127.777623:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792345856:0@lo:400:kworker.0 00000100:00100000:3.0:1788330127.777638:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792346368:0@lo:400:kworker.0 00002000:00000024:2.0:1788330127.778369:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330127.778441:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792347136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1951us (2098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330127.778449:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788330127.778476:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788330127.778487:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792347008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788330127.778578:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330127.778615:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792347008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (2216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330127.778620:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788330127.778778:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792345600:0@lo:400:kworker.0 00010000:00080000:2.0:1788330127.778800:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc730d180 x1875199792346112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330127.778811:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792346112:0@lo:400:kworker.0 00010000:00080000:2.0:1788330127.778823:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fc000 x1875199792346624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330127.778831:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792346624:0@lo:400:kworker.0 00010000:00080000:2.0:1788330127.778844:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc730f100 x1875199792345984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330127.778852:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792345984:0@lo:400:kworker.0 00010000:00080000:2.0:1788330127.778863:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fed80 x1875199792346496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330127.778871:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792346496:0@lo:400:kworker.0 00010000:00080000:0.0:1788330127.779044:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc5ee9180 x1875199792347008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330143 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330127.779064:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792347008:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788330127.779094:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc5eea680 x1875199792347136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330143 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330127.779111:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792347136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788330127.779262:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788330127.779272:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792346240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330127.779320:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792346240:12345-0@lo:400:kworker.0 Request processed in 51us (7700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330127.779326:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1788330127.779354:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc730ce00 x1875199792346240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330127.779363:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792346240:0@lo:400:kworker.0 00010000:00010000:0.0:1788330128.283525:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330129.307637:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792347264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330129.307746:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330129.307902:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792347264 00000100:00100000:3.0:1788330129.307914:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792347264 00000100:00100000:3.0:1788330129.308027:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788330129.308041:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792347264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330129.308086:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788330129.308789:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330129.308976:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792347392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330129.315092:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792347264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7034us (7327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330129.315303:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788330129.315546:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330129.317040:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792347392 00000100:00100000:3.0:1788330129.317068:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792347392 00000100:00100000:3.0:1788330129.317368:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788330129.317382:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792347392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788330129.317419:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330129.317541:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792347392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 163us (1995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330129.317549:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788330129.317580:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788330129.317622:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef58c8700 x1875199792347392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330129.317648:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792347392:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788330129.319369:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788330129.321788:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eee7640a80 x1875199792347264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330129.321834:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792347264:0@lo:13:osp-pre-0-0.0 00000020:00000004:3.0:1788330130.054124:0:12606:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788330130.055421:0:12606:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788330130.331311:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330130.332087:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792347520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330130.332284:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330130.332634:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792347520 00000100:00100000:0.0:1788330130.332645:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792347520 00000100:00100000:0.0:1788330130.332710:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788330130.332722:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792347520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788330130.332768:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788330130.332829:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792347520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330130.332836:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788330130.332905:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792347520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330131.170443:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330131.170502:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330131.170642:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766054016 00000100:00100000:2.0:1788330131.170656:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766054016 00000100:00100000:2.0:1788330131.170745:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 312 00000100:00100000:2.0:1788330131.170759:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2410:x1875199766054016:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330131.170880:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2410:x1875199766054016:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 124us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330131.170889:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 312 00000100:00100000:2.0:1788330131.170944:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766054144 00000100:00100000:2.0:1788330131.170948:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766054144 00000100:00100000:2.0:1788330131.171008:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 171 00000100:00100000:2.0:1788330131.171017:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766054144:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330131.171054:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766054144:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 39us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330131.171061:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 171 00000100:00080000:2.0:1788330131.171080:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330131.177213:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330131.177268:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330131.177296:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766054656 00000100:00100000:3.0:1788330131.177298:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330131.177311:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766054656 00000100:00100000:3.0:1788330131.177318:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330131.177344:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330131.177364:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766054784 00000100:00100000:3.0:1788330131.177368:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766054784 00000100:00100000:2.0:1788330131.177396:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:2.0:1788330131.177416:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2409:x1875199766054656:12345-192.168.202.50@tcp:9:kworker.0 00000020:00000080:2.0:1788330131.177462:0:8440:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0fc3 00000100:00080000:2.0:1788330131.177474:0:8440:0:(import.c:65:import_set_state_nolock()) ffff99edc75d0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788330131.177551:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788330131.177772:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+2:2409:x1875199766054656:12345-192.168.202.50@tcp:9:kworker.0 Request processed in 360us (576us total) trans 0 rc 0/0 00000100:00080000:0.0:1788330131.180420:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330131.180433:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330131.180457:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766054400 00000100:00100000:0.0:1788330131.180471:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766054400 00000100:00100000:0.0:1788330131.180760:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766054272 00000100:00100000:0.0:1788330131.180766:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766054272 00000100:00100000:0.0:1788330131.180784:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766054528 00000100:00100000:0.0:1788330131.180787:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766054528 00000100:00100000:0.0:1788330131.180815:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 172 00000100:00100000:0.0:1788330131.180828:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766054400:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330131.180942:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766054400:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 106us (3631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330131.180963:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 172 00000100:00100000:0.0:1788330131.181058:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 173 00000100:00100000:0.0:1788330131.181066:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766054272:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330131.181099:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766054272:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 34us (3778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330131.181105:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 173 00000100:00100000:0.0:1788330131.181120:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 174 00000100:00100000:0.0:1788330131.181227:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766054528:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330131.181257:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766054528:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 132us (3912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330131.181265:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 174 00000100:00080000:0.0:1788330131.181285:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788330131.181289:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788330131.182971:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330131.183557:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:3.0:1788330131.183585:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2409:x1875199766054784:12345-192.168.202.50@tcp:9:kworker.0 00000020:00000080:3.0:1788330131.183629:0:8437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0fca 00000100:00080000:3.0:1788330131.183652:0:8437:0:(import.c:65:import_set_state_nolock()) ffff99edc75d7000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788330131.183726:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:0.0:1788330131.183907:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330131.184014:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+2:2409:x1875199766054784:12345-192.168.202.50@tcp:9:kworker.0 Request processed in 442us (6744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330131.184024:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:2.0:1788330131.189626:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 22 00010000:00010000:2.0:1788330131.357383:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330132.379441:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788330132.473777:0:12704:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788330132.474083:0:12704:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788330132.891354:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330132.891388:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792347648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330132.891488:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330132.891585:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792347648 00000100:00100000:0.0:1788330132.891596:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792347648 00000100:00100000:0.0:1788330132.891669:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788330132.891682:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792347648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788330132.891721:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330132.891778:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792347648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330132.891796:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1788330132.891827:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788330132.891882:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eee7642d80 x1875199792347648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330132.891904:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792347648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330132.892090:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788330132.892103:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792347776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330132.892141:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330132.892191:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792347776 00000100:00100000:2.0:1788330132.892201:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792347776 00000100:00100000:2.0:1788330132.892234:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788330132.892240:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792347776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788330132.892252:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330132.892283:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792347776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330132.892290:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1788330132.892306:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788330132.892325:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef58c9180 x1875199792347776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330132.892339:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792347776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330132.893059:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792347904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330132.893112:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330132.896582:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792347904 00000100:00100000:2.0:1788330132.896607:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792347904 00000100:00100000:2.0:1788330132.896717:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788330132.896732:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792347904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788330132.896790:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788330132.896933:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792347904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 204us (3819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330132.896943:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788330132.897047:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792347904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330132.900445:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792348032:0@lo:400:kworker.0 00000100:00100000:0.0:1788330132.900552:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330132.902276:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792348032 00000100:00100000:1.0:1788330132.902295:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792348032 00000100:00100000:1.0:1788330132.902368:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788330132.902381:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3646:x1875199792348032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330132.908236:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3646:x1875199792348032:12345-0@lo:400:kworker.0 Request processed in 5840us (7666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330132.908260:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788330132.908367:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792348160:0@lo:400:kworker.0 00000100:00100000:1.0:1788330132.908444:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330132.909121:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792348672:0@lo:400:kworker.0 00000100:00100000:1.0:1788330132.909179:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330132.912819:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792348032:0@lo:400:kworker.0 00000100:00100000:0.0:1788330132.912891:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792348544:0@lo:400:kworker.0 00000100:00100000:1.0:1788330132.913661:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330132.915632:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792348416:0@lo:400:kworker.0 00000100:00100000:3.0:1788330132.915736:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792348288:0@lo:400:kworker.0 00000100:00100000:3.0:1788330132.915775:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330132.915822:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792348800:0@lo:400:kworker.0 00000100:00100000:3.0:1788330132.915852:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330132.915901:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792348800 00000100:00100000:3.0:1788330132.915911:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792348800 00000100:00100000:3.0:1788330132.916004:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788330132.916017:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792348800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330132.916088:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792348800:12345-0@lo:400:kworker.0 Request processed in 73us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330132.916098:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:3.0:1788330132.916192:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fc000 x1875199792348800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330132.916208:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792348800:0@lo:400:kworker.0 00000100:00080000:3.0:1788330132.916245:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330132.916278:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792348288 00000100:00100000:3.0:1788330132.916282:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792348288 00000100:00100000:3.0:1788330132.916310:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788330132.916317:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792348288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330132.916356:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792348288:12345-0@lo:400:kworker.0 Request processed in 40us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330132.916373:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788330132.916399:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792348288:0@lo:400:kworker.0 00000100:00100000:2.0:1788330132.917274:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792348160 00000100:00100000:2.0:1788330132.917284:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792348160 00000100:00100000:1.0:1788330132.920770:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792349056:0@lo:400:kworker.0 00000100:00100000:1.0:1788330132.920873:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330132.920941:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792348672 00000100:00100000:1.0:1788330132.920963:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792348672 00000100:00100000:1.0:1788330132.921028:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792348544 00000100:00100000:1.0:1788330132.921032:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792348544 00000100:00100000:1.0:1788330132.921048:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792349056 00000100:00100000:1.0:1788330132.921050:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792349056 00000100:00100000:1.0:1788330132.921072:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788330132.921082:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792348672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330132.921343:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792348672:12345-0@lo:400:kworker.0 Request processed in 261us (12162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330132.921352:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788330132.921372:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788330132.921379:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792348544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330132.921426:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792348544:12345-0@lo:400:kworker.0 Request processed in 48us (7768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330132.921432:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788330132.921444:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788330132.921451:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792349056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330132.921477:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792349056:12345-0@lo:400:kworker.0 Request processed in 28us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330132.921483:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:1.0:1788330132.921506:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788330132.921511:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788330132.921523:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330132.921553:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792348928:0@lo:400:kworker.0 00000100:00100000:1.0:1788330132.921583:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330132.921608:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792348416 00000100:00100000:1.0:1788330132.921612:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792348416 00000100:00100000:1.0:1788330132.921632:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788330132.921637:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792348416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330132.921669:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792348416:12345-0@lo:400:kworker.0 Request processed in 31us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330132.921675:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788330132.921723:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792348416:0@lo:400:kworker.0 00010000:00080000:1.0:1788330132.921773:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fed80 x1875199792348672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330132.921786:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792348672:0@lo:400:kworker.0 00000100:00100000:1.0:1788330132.921793:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792349184:0@lo:400:kworker.0 00000100:00100000:1.0:1788330132.921819:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330132.921838:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792349184 00000100:00100000:1.0:1788330132.921842:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792349184 00000100:00100000:1.0:1788330132.921950:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788330132.922664:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792349184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330132.922721:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792349184:12345-0@lo:400:kworker.0 Request processed in 65us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330132.922728:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:1.0:1788330132.922758:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788330132.922783:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefe7eaa00 x1875199792349184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330132.922796:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792349184:0@lo:400:kworker.0 00000100:00100000:2.0:1788330132.923285:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792348928 00000100:00100000:2.0:1788330132.923294:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792348928 00000100:00100000:2.0:1788330132.923351:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788330132.923359:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792348928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330132.923427:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792348928:12345-0@lo:400:kworker.0 Request processed in 70us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330132.923434:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1788330132.923457:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330132.923499:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792348544:0@lo:400:kworker.0 00000100:00100000:2.0:1788330132.923516:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792349056:0@lo:400:kworker.0 00000100:00100000:3.0:1788330132.924460:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788330132.924473:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792348160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330132.924552:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792348160:12345-0@lo:400:kworker.0 Request processed in 83us (16108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330132.924559:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00010000:00080000:1.0:1788330132.924712:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefe7e9500 x1875199792348928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330132.924727:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792348928:0@lo:400:kworker.0 00000100:00100000:1.0:1788330132.924760:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792348160:0@lo:400:kworker.0 00010000:00010000:0.0:1788330133.403723:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330134.427342:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330134.427377:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792349312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330134.427479:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330134.427526:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792349312 00000100:00100000:1.0:1788330134.427537:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792349312 00000100:00100000:1.0:1788330134.427617:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788330134.427630:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792349312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330134.427676:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330134.427681:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330134.427694:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792349440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330134.427735:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792349312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330134.427743:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330134.427750:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788330134.427775:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792349440 00000100:00100000:1.0:1788330134.427779:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792349440 00000100:00100000:1.0:1788330134.427808:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788330134.427815:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792349440:12345-0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788330134.427821:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eee7640700 x1875199792349312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00000024:1.0:1788330134.427827:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330134.427849:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792349312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330134.427866:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792349440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330134.427873:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1788330134.427894:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788330134.427897:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc730c380 x1875199792349440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330134.427921:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792349440:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788330134.432207:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788330135.083610:0:12801:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788330135.083882:0:12801:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788330135.451396:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792349568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330135.451521:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330135.452278:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792349568 00000100:00100000:3.0:1788330135.452291:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792349568 00000100:00100000:3.0:1788330135.452354:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788330135.452374:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792349568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788330135.452427:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788330135.452501:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792349568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330135.452510:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788330135.453024:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792349568:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788330135.453072:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330136.292203:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330136.292242:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330136.292281:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330136.292308:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330136.292353:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330136.292386:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766054912 00000100:00100000:3.0:1788330136.292402:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766054912 00000100:00100000:3.0:1788330136.292470:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 314 00000100:00100000:3.0:1788330136.292485:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2410:x1875199766054912:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330136.292589:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2410:x1875199766054912:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 108us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330136.292598:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 314 00000100:00100000:1.0:1788330136.292709:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766055040 00000100:00100000:1.0:1788330136.292714:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766055040 00000100:00100000:1.0:1788330136.292768:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766055296 00000100:00100000:1.0:1788330136.292771:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766055296 00000100:00100000:1.0:1788330136.292788:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766055168 00000100:00100000:1.0:1788330136.292792:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766055168 00000100:00100000:1.0:1788330136.292807:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766055424 00000100:00100000:1.0:1788330136.292810:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766055424 00000100:00100000:1.0:1788330136.292826:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 181 00000100:00100000:1.0:1788330136.292832:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766055040:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330136.292871:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766055040:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 40us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330136.292878:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 181 00000100:00100000:1.0:1788330136.292903:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 182 00000100:00100000:1.0:1788330136.292909:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766055296:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330136.292944:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766055296:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 36us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330136.292950:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 182 00000100:00100000:1.0:1788330136.292960:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 183 00000100:00100000:1.0:1788330136.292965:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766055168:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330136.293002:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766055168:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 36us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330136.293008:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 183 00000100:00100000:1.0:1788330136.293020:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 184 00000100:00100000:1.0:1788330136.293026:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766055424:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330136.293052:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766055424:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 26us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330136.293059:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 184 00000100:00080000:3.0:1788330136.293545:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788330136.293552:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788330136.475480:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788330136.993060:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7ef8caa6-b8a4-4292-af89-d5e39e506906 00000020:00000080:1.0:1788330136.993076:0:8433:0:(genops.c:885:class_export_put()) final put ffff99edc75d2800/7ef8caa6-b8a4-4292-af89-d5e39e506906 00000020:00000080:3.0:1788330136.993143:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc75d2800/7ef8caa6-b8a4-4292-af89-d5e39e506906 for lustre-OST0000 00000020:00000080:3.0:1788330136.993264:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc75d0000 for lustre-OST0000 00000001:00100000:1.0:1788330136.994496:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7ef8caa6-b8a4-4292-af89-d5e39e506906 00000020:00000080:1.0:1788330136.994506:0:9518:0:(genops.c:885:class_export_put()) final put ffff99edc75d3000/7ef8caa6-b8a4-4292-af89-d5e39e506906 00000020:00000080:3.0:1788330136.994592:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc75d3000/7ef8caa6-b8a4-4292-af89-d5e39e506906 for lustre-OST0001 00000020:00000080:3.0:1788330136.994637:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc75d7000 for lustre-OST0001 00010000:00010000:3.0:1788330137.499341:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788330137.636553:0:12900:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788330137.636921:0:12900:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788330138.011448:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792349696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330138.011585:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330138.012858:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792349824:0@lo:400:kworker.0 00000100:00100000:0.0:1788330138.012864:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792349696 00000100:00100000:0.0:1788330138.012890:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792349696 00000100:00100000:0.0:1788330138.012962:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788330138.012968:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330138.012979:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792349696:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330138.013015:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792349952:0@lo:13:osp-pre-1-1.0 00000004:00000024:0.0:1788330138.013032:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788330138.013050:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330138.013103:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792349952 00000100:00100000:0.0:1788330138.013108:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792349696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330138.013109:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792349952 00000100:00100000:0.0:1788330138.013120:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788330138.013191:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788330138.013203:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792349952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788330138.013229:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330138.013273:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792349952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330138.013278:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1788330138.013300:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788330138.013344:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fc000 x1875199792349952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330138.013365:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792349952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788330138.013384:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330138.013392:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792350080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330138.013424:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330138.013457:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792350080 00000100:00100000:3.0:1788330138.013461:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792350080 00000100:00100000:3.0:1788330138.013496:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788330138.013502:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792350080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330138.013516:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330138.013566:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792350080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330138.013571:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788330138.013595:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788330138.013629:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eee7640a80 x1875199792350080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330138.013642:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792350080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330138.014007:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792349824 00000100:00100000:1.0:1788330138.014014:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792349824 00000100:00100000:1.0:1788330138.014056:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788330138.014065:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3648:x1875199792349824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330138.014120:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3648:x1875199792349824:12345-0@lo:400:kworker.0 Request processed in 57us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330138.014128:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788330138.014209:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792349824:0@lo:400:kworker.0 00000100:00100000:1.0:1788330138.014254:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792349696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330138.014753:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330138.022396:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792350208:0@lo:400:kworker.0 00000100:00100000:0.0:1788330138.022529:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330138.022595:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330138.022604:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792350336:0@lo:400:kworker.0 00000100:00100000:2.0:1788330138.022797:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330138.022810:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792350592:0@lo:400:kworker.0 00000100:00100000:2.0:1788330138.022849:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330138.022908:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792350208 00000100:00100000:2.0:1788330138.022919:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792350208 00000100:00100000:2.0:1788330138.022982:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792350592 00000100:00100000:2.0:1788330138.022986:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792350592 00000100:00100000:2.0:1788330138.023027:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788330138.023040:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792350208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330138.024695:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792350464:0@lo:400:kworker.0 00000100:00100000:1.0:1788330138.024797:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330138.025117:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330138.025647:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792350336 00000100:00100000:1.0:1788330138.025658:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792350336 00000100:00100000:0.0:1788330138.025698:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792350464 00000100:00100000:0.0:1788330138.025706:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792350464 00000100:00100000:1.0:1788330138.025726:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788330138.025743:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788330138.025745:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792350336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330138.025758:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792350592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330138.025828:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792350592:12345-0@lo:400:kworker.0 Request processed in 75us (2978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330138.025837:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788330138.025862:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788330138.025878:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792350464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330138.029919:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792350208:12345-0@lo:400:kworker.0 Request processed in 6861us (7371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330138.029944:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:2.0:1788330138.030014:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330138.030231:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792350592:0@lo:400:kworker.0 00000100:00100000:1.0:1788330138.030374:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792350336:12345-0@lo:400:kworker.0 Request processed in 4634us (5253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330138.030386:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788330138.032127:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792350464:12345-0@lo:400:kworker.0 Request processed in 6244us (7316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330138.032145:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788330138.032213:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792350720:0@lo:400:kworker.0 00000100:00100000:0.0:1788330138.032301:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330138.032903:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792350848:0@lo:400:kworker.0 00000100:00100000:2.0:1788330138.033310:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330138.033389:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792350848 00000100:00100000:2.0:1788330138.033401:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792350848 00000100:00100000:2.0:1788330138.033485:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788330138.033501:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792350848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330138.033656:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792350848:12345-0@lo:400:kworker.0 Request processed in 159us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330138.033664:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788330138.033693:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788330138.033730:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefe7e9500 x1875199792350848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330138.033747:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792350848:0@lo:400:kworker.0 00000100:00100000:2.0:1788330138.033800:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792350976:0@lo:400:kworker.0 00000100:00100000:2.0:1788330138.033835:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330138.033867:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792350976 00000100:00100000:2.0:1788330138.033882:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792350976 00000100:00100000:2.0:1788330138.033918:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788330138.033925:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792350976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330138.037339:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792350720 00000100:00100000:1.0:1788330138.037360:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792350720 00000100:00100000:1.0:1788330138.037448:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788330138.037464:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792350720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330138.040361:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792350336:0@lo:400:kworker.0 00000100:00100000:0.0:1788330138.040391:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792350208:0@lo:400:kworker.0 00000100:00100000:0.0:1788330138.040464:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792350464:0@lo:400:kworker.0 00000100:00100000:2.0:1788330138.042708:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792350976:12345-0@lo:400:kworker.0 Request processed in 8772us (8862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330138.042730:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788330138.042786:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788330138.042796:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330138.042893:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792351104:0@lo:400:kworker.0 00000100:00100000:2.0:1788330138.042974:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330138.043024:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792351104 00000100:00100000:2.0:1788330138.043034:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792351104 00010000:00080000:0.0:1788330138.043439:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefe7e9500 x1875199792350976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330138.043458:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792350976:0@lo:400:kworker.0 00000100:00080000:3.0:1788330138.043701:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330138.043729:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788330138.043748:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788330138.043751:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792351104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330138.043761:0:6522:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788330138.043834:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792351104:12345-0@lo:400:kworker.0 Request processed in 87us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330138.043843:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788330138.043895:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792351104:0@lo:400:kworker.0 00000100:00100000:2.0:1788330138.043920:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788330138.043934:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792351232:0@lo:400:kworker.0 00000100:00100000:2.0:1788330138.043965:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330138.044028:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792351232 00000100:00100000:3.0:1788330138.044041:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792351232 00000100:00100000:3.0:1788330138.044079:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788330138.044288:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792351232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330138.044343:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792351232:12345-0@lo:400:kworker.0 Request processed in 256us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330138.044351:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00010000:00080000:3.0:1788330138.044384:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefe7ef480 x1875199792351232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330138.044395:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792351232:0@lo:400:kworker.0 00000100:00080000:3.0:1788330138.044410:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788330138.044754:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792350720:12345-0@lo:400:kworker.0 Request processed in 7292us (12449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330138.044765:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00010000:00080000:0.0:1788330138.044859:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefe7e9c00 x1875199792350720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330138.044879:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792350720:0@lo:400:kworker.0 00010000:00010000:2.0:1788330138.523379:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330139.550630:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330139.551039:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330139.551070:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792351360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788330139.551186:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330139.551451:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792351488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330139.551489:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330139.551548:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792351360 00000100:00100000:3.0:1788330139.551559:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792351360 00000100:00100000:3.0:1788330139.551613:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792351488 00000100:00100000:3.0:1788330139.551616:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792351488 00000100:00100000:3.0:1788330139.551634:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788330139.551645:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792351360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788330139.551687:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330139.551755:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792351360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330139.551762:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788330139.551784:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788330139.551791:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792351488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330139.551801:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330139.551829:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792351488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330139.551835:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1788330139.551890:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef58c8700 x1875199792351488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330139.551915:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792351488:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788330139.551953:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc1ad80 x1875199792351360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330139.551965:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792351360:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788330140.571383:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330140.571530:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792351616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330140.571620:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330140.571760:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792351616 00000100:00100000:3.0:1788330140.571769:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792351616 00000100:00100000:3.0:1788330140.571819:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788330140.571829:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792351616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788330140.571872:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788330140.571920:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792351616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330140.571926:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788330140.572091:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792351616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330141.084422:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792351744:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.084423:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792351872:0@lo:400:kworker.0 00000100:00100000:3.0:1788330141.084505:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792352000:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.084506:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330141.084511:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330141.084545:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330141.084568:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792352384:0@lo:400:kworker.0 00000100:00100000:1.0:1788330141.084578:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792352256:0@lo:400:kworker.0 00000100:00100000:3.0:1788330141.084581:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792352512:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.084590:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330141.084609:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792352896:0@lo:400:kworker.0 00000100:00100000:1.0:1788330141.084629:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330141.084630:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330141.084652:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792351872 00000100:00100000:1.0:1788330141.084658:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792352768:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.084659:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792351872 00000100:00100000:3.0:1788330141.084665:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792353024:0@lo:400:kworker.0 00000100:00100000:1.0:1788330141.084701:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330141.084702:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330141.084708:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792352384 00000100:00100000:2.0:1788330141.084713:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792352384 00000100:00100000:3.0:1788330141.084720:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788330141.084727:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792352128:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.084743:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792352512 00000100:00100000:1.0:1788330141.084745:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792353280:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.084747:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792352512 00000100:00100000:3.0:1788330141.084755:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330141.084766:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792353024 00000100:00100000:3.0:1788330141.084769:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792352640:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.084769:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792353024 00000100:00100000:1.0:1788330141.084786:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330141.084788:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792352128 00000100:00100000:2.0:1788330141.084792:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792352128 00000100:00100000:3.0:1788330141.084812:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792352000 00000100:00100000:3.0:1788330141.084815:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792352000 00000100:00100000:2.0:1788330141.084815:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788330141.084823:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792351872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330141.084856:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792351744 00000100:00100000:1.0:1788330141.084861:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792351744 00000100:00100000:3.0:1788330141.084873:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792352256 00000100:00100000:2.0:1788330141.084895:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792351872:12345-0@lo:400:kworker.0 Request processed in 72us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330141.084897:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788330141.084907:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec2d19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3646:x1875199792351744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.084915:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788330141.084939:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788330141.084945:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792352256 00000100:00100000:2.0:1788330141.084949:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792352384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330141.084952:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec2d19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3646:x1875199792351744:12345-0@lo:400:kworker.0 Request processed in 46us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330141.084962:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788330141.084967:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788330141.084976:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792352000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.084989:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792352384:12345-0@lo:400:kworker.0 Request processed in 42us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330141.084996:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788330141.085002:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788330141.085011:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792352000:12345-0@lo:400:kworker.0 Request processed in 36us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330141.085016:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788330141.085017:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792352256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.085026:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792352512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330141.085060:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792352256:12345-0@lo:400:kworker.0 Request processed in 49us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330141.085071:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792352512:12345-0@lo:400:kworker.0 Request processed in 47us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330141.085078:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788330141.085092:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788330141.085099:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792353024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.085133:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792353024:12345-0@lo:400:kworker.0 Request processed in 35us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330141.085140:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788330141.085178:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788330141.085185:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792352128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.085220:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792352128:12345-0@lo:400:kworker.0 Request processed in 36us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330141.085226:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788330141.085254:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792352768 00000100:00100000:2.0:1788330141.085258:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792352768 00000100:00100000:2.0:1788330141.085286:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792353280 00000100:00100000:2.0:1788330141.085290:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792353280 00000100:00100000:2.0:1788330141.085326:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788330141.085334:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792352768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.085373:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792352768:12345-0@lo:400:kworker.0 Request processed in 41us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330141.085380:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788330141.085385:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788330141.085393:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788330141.085396:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788330141.085407:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792353280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330141.085410:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330141.085428:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792353152:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.085439:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792353280:12345-0@lo:400:kworker.0 Request processed in 35us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330141.085445:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788330141.085456:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792352256:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.085459:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792352640 00000100:00100000:2.0:1788330141.085464:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792352640 00010000:00080000:1.0:1788330141.085474:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6fe7b80 x1875199792352768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330141.085485:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792352768:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.085488:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788330141.085500:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792352640:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788330141.085504:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcf8e00 x1875199792353280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330141.085515:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792353280:0@lo:400:kworker.0 00000100:00100000:1.0:1788330141.085527:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792351744:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.085539:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792352640:12345-0@lo:400:kworker.0 Request processed in 40us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330141.085545:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1788330141.085562:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330141.085567:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788330141.085570:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788330141.085573:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330141.085594:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330141.085629:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792351872:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.085656:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792352384:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.085674:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792352896 00000100:00100000:2.0:1788330141.085677:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792352896 00000100:00100000:2.0:1788330141.085718:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00080000:1.0:1788330141.085724:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330141.085736:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792352896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.085777:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792352896:12345-0@lo:400:kworker.0 Request processed in 46us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330141.085784:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788330141.085811:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792352896:0@lo:400:kworker.0 00000100:00100000:3.0:1788330141.085957:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330141.085984:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792352000:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.085989:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792353152 00000100:00100000:2.0:1788330141.085992:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792353152 00010000:00080000:3.0:1788330141.085995:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc9f100 x1875199792352512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330141.086005:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792352512:0@lo:400:kworker.0 00010000:00080000:3.0:1788330141.086015:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6fe4380 x1875199792353024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330141.086024:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788330141.086032:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792353152:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788330141.086033:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330141.086046:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792353024:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.086068:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792353152:12345-0@lo:400:kworker.0 Request processed in 38us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330141.086069:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792352128:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.086074:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1788330141.086079:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6fe6300 x1875199792352640/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330141.086087:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792352640:0@lo:400:kworker.0 00010000:00080000:3.0:1788330141.086096:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcf9f80 x1875199792353152/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330141.086104:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792353152:0@lo:400:kworker.0 00000100:00100000:1.0:1788330141.410287:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330141.410332:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330141.410356:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330141.410376:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330141.410400:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330141.410428:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766055808 00000100:00100000:1.0:1788330141.410437:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766055808 00000100:00100000:1.0:1788330141.410496:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766056064 00000100:00100000:1.0:1788330141.410500:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766056064 00000100:00100000:1.0:1788330141.410514:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766055680 00000100:00100000:1.0:1788330141.410516:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766055680 00000100:00100000:1.0:1788330141.410528:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766055936 00000100:00100000:1.0:1788330141.410530:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766055936 00000100:00100000:1.0:1788330141.410544:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 197 00000100:00100000:1.0:1788330141.410552:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766055808:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330141.410626:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766055808:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 74us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330141.410633:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 197 00000100:00100000:1.0:1788330141.410649:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 198 00000100:00100000:1.0:1788330141.410656:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766056064:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330141.410680:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766056064:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330141.410686:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 198 00000100:00100000:1.0:1788330141.410697:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 199 00000100:00100000:1.0:1788330141.410704:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766055680:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330141.410741:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766055680:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 37us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330141.410747:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 199 00000100:00100000:1.0:1788330141.410759:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 200 00000100:00100000:1.0:1788330141.410766:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766055936:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330141.410789:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766055936:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 24us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330141.410795:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 200 00000100:00080000:1.0:1788330141.410823:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788330141.410827:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788330141.411015:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766055552 00000100:00100000:2.0:1788330141.411020:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766055552 00000100:00100000:2.0:1788330141.411058:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 317 00000100:00100000:2.0:1788330141.411066:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec2d19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2410:x1875199766055552:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330141.411107:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec2d19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2410:x1875199766055552:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 42us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330141.411114:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 317 00000001:02000400:2.0:1788330141.532947:0:13045:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788330141.597411:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330142.631006:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330143.131786:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792353408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788330143.131909:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330143.132012:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792353408 00000100:00100000:3.0:1788330143.132023:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792353408 00000100:00080000:2.0:1788330143.132134:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330143.132179:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788330143.132193:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792353408:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330143.132195:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792353536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330143.132231:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788330143.132237:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330143.132309:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792353408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330143.132317:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788330143.132335:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792353536 00000100:00100000:3.0:1788330143.132338:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792353536 00000100:00100000:3.0:1788330143.132362:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788330143.132367:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792353536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330143.132378:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330143.132414:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792353536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330143.132420:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1788330143.132441:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788330143.132471:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefe7eed80 x1875199792353536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330159 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330143.132496:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792353536:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788330143.132567:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6d40380 x1875199792353408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330159 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330143.132580:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792353408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788330143.134780:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788330143.134832:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792353664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330143.134926:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330143.136922:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792353664 00000100:00100000:3.0:1788330143.136940:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792353664 00000100:00100000:3.0:1788330143.137029:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788330143.137126:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792353664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788330143.137201:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788330143.137329:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792353664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 289us (2402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330143.137338:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788330143.137422:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792353664:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788330143.643385:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330144.668522:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792353792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330144.668609:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330144.668701:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792353792 00000100:00100000:3.0:1788330144.668712:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792353792 00000100:00100000:3.0:1788330144.668773:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788330144.668784:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792353792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788330144.668828:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330144.668954:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792353792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330144.668962:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1788330144.669015:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788330144.669119:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6d43800 x1875199792353792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330144.669138:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792353792:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788330144.670092:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330144.671590:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792353920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330144.671671:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330144.671800:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792353920 00000100:00100000:2.0:1788330144.671817:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792353920 00000100:00100000:2.0:1788330144.671907:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788330144.671917:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792353920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330144.671941:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330144.671987:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792353920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330144.671995:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788330144.672226:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788330144.672266:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefe7ed880 x1875199792353920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330144.672287:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792353920:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1788330145.189587:0:13193:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffdf9b6440 20000000:00000080:1.0:1788330145.189604:0:13193:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99eeffcffc00 uarg=0000000000000000 20000000:01000000:1.0:1788330145.189651:0:13193:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788330145.189657:0:13193:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788330145.189661:0:13193:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788330145.192832:0:13194:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788330145.193060:0:13193:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788330145.196576:0:13193:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788330145.196612:0:13193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd0fd1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.196647:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef6e79e00/0x8475908e9fd0f68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0f61 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.196653:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99edc765b400/0x8475908e9fd0f76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0f6f expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.196657:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd0f84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0f7d expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.196661:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99edc765bc00/0x8475908e9fd0f92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0f8b expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.196667:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef59cb400/0x8475908e9fd0f99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d23 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.196671:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99edc765b800/0x8475908e9fd0fae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d62 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.196675:0:13193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd0fd1 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.196713:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99edc765b800/0x8475908e9fd0fae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d62 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.196725:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99edc765b800/0x8475908e9fd0fae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d62 expref: 12 pid: 6516 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330145.196736:0:13193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875199792354048:192.168.202.50@tcp:104: 00010000:00010000:1.0:1788330145.196870:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef59cb400/0x8475908e9fd0f99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d23 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.196885:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eef59cb400/0x8475908e9fd0f99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d23 expref: 12 pid: 6515 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330145.196893:0:13193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875199792354176:192.168.202.50@tcp:104: 00010000:00010000:1.0:1788330145.196929:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99edc765bc00/0x8475908e9fd0f92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0f8b expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.196937:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99edc765bc00/0x8475908e9fd0f92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0f8b expref: 23 pid: 6515 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330145.196945:0:13193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875199792354304:0@lo:104: 00000100:00100000:1.0:1788330145.196985:0:13193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788330145.197021:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd0f84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0f7d expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.197029:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd0f84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0f7d expref: 23 pid: 6517 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330145.197035:0:13193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875199792354432:0@lo:104: 00000100:00100000:1.0:1788330145.197050:0:13193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788330145.197079:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99edc765b400/0x8475908e9fd0f76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0f6f expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.197086:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99edc765b400/0x8475908e9fd0f76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0f6f expref: 23 pid: 6517 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330145.197094:0:13193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875199792354560:0@lo:104: 00000100:00100000:1.0:1788330145.197132:0:13193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330145.197376:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792354304 00010000:00010000:1.0:1788330145.197379:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef6e79e00/0x8475908e9fd0f68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0f61 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.197395:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eef6e79e00/0x8475908e9fd0f68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0f61 expref: 23 pid: 6516 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330145.197397:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792354304 00000100:00100000:1.0:1788330145.197409:0:13193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875199792354688:0@lo:104: 00000100:00100000:1.0:1788330145.197441:0:13193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330145.197467:0:13193:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee733e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330145.197549:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792354432 00000100:00100000:2.0:1788330145.197558:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792354432 00000100:00100000:2.0:1788330145.197603:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792354560 00000100:00100000:2.0:1788330145.197605:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792354560 00000100:00100000:2.0:1788330145.197613:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792354688 00000100:00100000:2.0:1788330145.197615:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792354688 00000100:00100000:2.0:1788330145.197633:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788330145.197645:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+6:13193:x1875199792354304:12345-0@lo:104: 00010000:00010000:2.0:1788330145.197658:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0f8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0f92 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330145.197720:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788330145.197728:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+6:13193:x1875199792354304:12345-0@lo:104: Request processed in 85us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330145.197735:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1788330145.197752:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788330145.197757:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1788330145.197759:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0f8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0f92 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330145.197762:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+5:13193:x1875199792354432:12345-0@lo:104: 00010000:00010000:0.0:1788330145.197767:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c2800 already unused, calling callback (ffffffffc14efc20) 00010000:00010000:2.0:1788330145.197770:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd0f7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0f84 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330145.197771:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0f8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0f92 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330145.197780:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0f8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0f92 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330145.197787:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0f8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0f92 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330145.197794:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788330145.197815:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788330145.197825:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+5:13193:x1875199792354432:12345-0@lo:104: Request processed in 63us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330145.197831:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788330145.197845:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788330145.197851:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:13193:x1875199792354560:12345-0@lo:104: 00010000:00010000:0.0:1788330145.197855:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0f8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0f92 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330145.197857:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef59cb800/0x8475908e9fd0f6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0f76 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330145.197861:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330145.197883:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0f8b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0f92 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330145.197889:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1788330145.197890:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd0f8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0f92 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330145.197894:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:13193:x1875199792354560:12345-0@lo:104: Request processed in 43us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330145.197899:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:0.0:1788330145.197902:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788330145.197905:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd0f7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0f84 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330145.197910:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788330145.197911:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cbe00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330145.197914:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd0f7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0f84 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330145.197916:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:13193:x1875199792354688:12345-0@lo:104: 00010000:00010000:0.0:1788330145.197921:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd0f7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0f84 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330145.197922:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd0f61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0f68 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330145.197928:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd0f7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0f84 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330145.197933:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788330145.197944:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd0f7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0f84 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330145.197945:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788330145.197949:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:13193:x1875199792354688:12345-0@lo:104: Request processed in 34us (508us total) trans 0 rc 0/0 00010000:00010000:0.0:1788330145.197950:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788330145.197955:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788330145.197956:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd0f7d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0f84 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330145.197970:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788330145.197972:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd0f7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0f84 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330145.197974:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef59cb800/0x8475908e9fd0f6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0f76 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330145.197980:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb800 already unused, calling callback (ffffffffc14efc20) 00010000:00010000:0.0:1788330145.197981:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1788330145.197985:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef59cb800/0x8475908e9fd0f6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0f76 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330145.197985:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd0f61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0f68 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330145.197992:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79600 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330145.197995:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd0f61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0f68 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330145.198000:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330145.198003:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef59cb800/0x8475908e9fd0f6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0f76 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330145.198003:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd0f61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0f68 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330145.198013:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd0f61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0f68 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330145.198014:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef59cb800/0x8475908e9fd0f6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0f76 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330145.198020:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788330145.198020:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788330145.198034:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef59cb800/0x8475908e9fd0f6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0f76 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330145.198034:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd0f61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0f68 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330145.198040:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330145.198040:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788330145.198046:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef59cb800/0x8475908e9fd0f6f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0f76 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330145.198053:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef59cb800/0x8475908e9fd0f6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0f76 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330145.198062:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330145.198064:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330145.198065:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd0f61 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0f68 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330145.198066:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330145.198071:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef6e79600/0x8475908e9fd0f61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0f68 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330145.198082:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330145.198088:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330145.198090:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330145.198110:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792354816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330145.198127:0:13193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875199792354304:0@lo:104: 00000100:00100000:1.0:1788330145.198140:0:13193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875199792354432:0@lo:104: 00000100:00100000:3.0:1788330145.198145:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792355200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330145.198146:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330145.198181:0:13193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875199792354560:0@lo:104: 00000100:00100000:1.0:1788330145.198195:0:13193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875199792354688:0@lo:104: 00000100:00100000:0.0:1788330145.198208:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330145.198217:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792354944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330145.198262:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792354816 00000100:00100000:2.0:1788330145.198268:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792354816 00000100:00100000:3.0:1788330145.198283:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330145.198294:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99edc765bc00/0x8475908e9fd0f92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0f8b expref: 24 pid: 6515 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330145.198323:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792355200 00000100:00100000:2.0:1788330145.198326:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792355200 00000100:00100000:0.0:1788330145.198334:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330145.198338:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792355072:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330145.198341:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef6e79e00/0x8475908e9fd0f68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0f61 expref: 25 pid: 6516 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330145.198361:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792354944 00000100:00100000:2.0:1788330145.198370:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792354944 00000100:00100000:3.0:1788330145.198385:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330145.198388:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd0f84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0f7d expref: 26 pid: 6517 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330145.198391:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788330145.198404:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+26:3648:x1875199792354816:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330145.198411:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792355072 00000100:00100000:2.0:1788330145.198415:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792355072 00010000:00010000:0.0:1788330145.198420:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330145.198428:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99edc765b400/0x8475908e9fd0f76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0f6f expref: 27 pid: 6517 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330145.198428:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99edc765bc00/0x8475908e9fd0f92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0f8b expref: 27 pid: 6515 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330145.198440:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99edc765bc00/0x8475908e9fd0f92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0f8b expref: 27 pid: 6515 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330145.198448:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788330145.198454:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+27:3646:x1875199792355200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330145.198461:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330145.198465:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef6e79e00/0x8475908e9fd0f68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0f61 expref: 27 pid: 6516 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330145.198508:0:8454:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788330145.198516:0:8454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1788330145.198557:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef6e79e00/0x8475908e9fd0f68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0f61 expref: 27 pid: 6516 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330145.198573:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99edc765bc00/0x8475908e9fd0f92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0f8b expref: 27 pid: 6515 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330145.198574:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef6e79e00/0x8475908e9fd0f68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0f61 expref: 27 pid: 6516 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330145.198587:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330145.198587:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330145.198627:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+25:3646:x1875199792355200:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330145.198639:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788330145.198658:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788330145.198666:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3648:x1875199792354944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330145.198676:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330145.198681:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd0f84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0f7d expref: 24 pid: 6517 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330145.198684:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3648:x1875199792354816:12345-0@lo:103:ldlm_bl.0 Request processed in 282us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330145.198693:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1788330145.198699:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd0f84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0f7d expref: 24 pid: 6517 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330145.198712:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd0f84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0f7d expref: 23 pid: 6517 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330145.198712:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788330145.198720:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:3646:x1875199792355072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330145.198722:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330145.198728:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330145.198733:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99edc765b400/0x8475908e9fd0f76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0f6f expref: 22 pid: 6517 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330145.198746:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:3648:x1875199792354944:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (414us total) trans 0 rc 0/0 00010000:00010000:0.0:1788330145.198750:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99edc765b400/0x8475908e9fd0f76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0f6f expref: 22 pid: 6517 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330145.198751:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1788330145.198759:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99edc765b400/0x8475908e9fd0f76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0f6f expref: 21 pid: 6517 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330145.198768:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330145.198789:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:3646:x1875199792355072:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330145.198796:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788330145.198868:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792354816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330145.198882:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792354944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330145.198919:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792355200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330145.198924:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792355072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330145.202884:0:13193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875199792354048:192.168.202.50@tcp:104: 00000100:00100000:3.0:1788330145.202906:0:13193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875199792354176:192.168.202.50@tcp:104: 00010000:00010000:3.0:1788330145.202971:0:13193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd0fd1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330145.206704:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330145.206755:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766056320 00000100:00100000:2.0:1788330145.206767:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766056320 00010000:00010000:2.0:1788330145.206825:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef59cb400/0x8475908e9fd0f99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d23 expref: 13 pid: 6515 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330145.206874:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:2.0:1788330145.206884:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2413:x1875199766056320:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330145.206899:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330145.206908:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef59cb400/0x8475908e9fd0f99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d23 expref: 13 pid: 6515 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330145.206921:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef59cb400/0x8475908e9fd0f99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d23 expref: 13 pid: 6515 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330145.206939:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef59cb400/0x8475908e9fd0f99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d23 expref: 13 pid: 6515 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330145.206956:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330145.207030:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa3490c8-da14-415b-81e3-af4ba0c476db+12:2413:x1875199766056320:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 147us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330145.207037:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:0.0:1788330145.207127:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330145.208209:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766056192 00000100:00100000:1.0:1788330145.208219:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766056192 00010000:00010000:1.0:1788330145.208250:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99edc765b800/0x8475908e9fd0fae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d62 expref: 12 pid: 6516 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330145.208290:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 45 00000100:00100000:1.0:1788330145.208299:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec986cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa3490c8-da14-415b-81e3-af4ba0c476db+12:2413:x1875199766056192:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330145.208320:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330145.208325:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99edc765b800/0x8475908e9fd0fae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d62 expref: 12 pid: 6516 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.208338:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99edc765b800/0x8475908e9fd0fae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d62 expref: 12 pid: 6516 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.208353:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99edc765b800/0x8475908e9fd0fae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d62 expref: 12 pid: 6516 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.208366:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd0fd1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.208376:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd0fd1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.208391:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd0fd1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.208399:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd0fd1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.208406:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd0fd1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.208414:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd0fd1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.208420:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78e00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330145.208425:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd0fd1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.208442:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd0fd1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.208460:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd0fd1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330145.208471:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330145.208508:0:13193:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd0fd1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330145.208520:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec986cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa3490c8-da14-415b-81e3-af4ba0c476db+11:2413:x1875199766056192:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 220us (1392us total) trans 0 rc 0/0 00010000:00010000:2.0:1788330145.208521:0:13193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd0fd1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330145.208533:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 45 00010000:00010000:2.0:1788330145.208538:0:13193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd0fd1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330145.691419:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330145.691470:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792355328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330145.691544:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330145.691606:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792355328 00000100:00100000:1.0:1788330145.691615:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792355328 00000100:00100000:1.0:1788330145.691663:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788330145.691672:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792355328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788330145.691713:0:7831:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788330145.691956:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792355328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 278us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330145.691964:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788330145.692142:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792355328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330146.205452:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792355584:0@lo:400:kworker.0 00000100:00100000:0.0:1788330146.205556:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330146.205642:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792356096:0@lo:400:kworker.0 00000100:00100000:0.0:1788330146.205667:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330146.205714:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788330146.205721:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792355456:0@lo:400:kworker.0 00000100:00100000:0.0:1788330146.205761:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330146.205782:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792355968:0@lo:400:kworker.0 00000100:00100000:0.0:1788330146.205848:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330146.206013:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792355968 00000100:00100000:0.0:1788330146.206039:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792355968 00000100:00100000:0.0:1788330146.206090:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788330146.206101:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792355968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330146.206196:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792355968:12345-0@lo:400:kworker.0 Request processed in 96us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330146.206204:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788330146.206232:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792355840:0@lo:400:kworker.0 00000100:00100000:0.0:1788330146.206257:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330146.206580:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792355712:0@lo:400:kworker.0 00000100:00100000:3.0:1788330146.206611:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330146.206640:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792356224:0@lo:400:kworker.0 00000100:00100000:3.0:1788330146.206667:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330146.206680:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792356736:0@lo:400:kworker.0 00000100:00100000:3.0:1788330146.206707:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330146.206722:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330146.206727:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792356864:0@lo:400:kworker.0 00000100:00100000:3.0:1788330146.206748:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330146.206775:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792356864 00000100:00100000:3.0:1788330146.206779:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792356864 00000100:00100000:0.0:1788330146.207253:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792356352:0@lo:400:kworker.0 00000100:00100000:0.0:1788330146.207294:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330146.207326:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792356608:0@lo:400:kworker.0 00000100:00100000:0.0:1788330146.207348:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330146.207380:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792355968:0@lo:400:kworker.0 00000100:00100000:0.0:1788330146.207397:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788330146.207402:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792356480:0@lo:400:kworker.0 00000100:00100000:0.0:1788330146.207422:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330146.207435:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792356992:0@lo:400:kworker.0 00000100:00100000:0.0:1788330146.207453:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788330146.207488:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330146.207505:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792356352 00000100:00100000:0.0:1788330146.207508:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792356352 00000100:00100000:0.0:1788330146.207535:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792356480 00000100:00100000:0.0:1788330146.207539:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792356480 00000100:00100000:0.0:1788330146.207549:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792356992 00000100:00100000:0.0:1788330146.207552:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792356992 00000100:00100000:0.0:1788330146.207563:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788330146.207570:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792356864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330146.207624:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792356864:12345-0@lo:400:kworker.0 Request processed in 54us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330146.207630:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788330146.207645:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788330146.207650:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792356352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330146.207679:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792356352:12345-0@lo:400:kworker.0 Request processed in 29us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330146.207685:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788330146.207717:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788330146.207723:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792356480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330146.207757:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792356480:12345-0@lo:400:kworker.0 Request processed in 34us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330146.207763:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788330146.207773:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788330146.207779:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792356992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330146.207819:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792356992:12345-0@lo:400:kworker.0 Request processed in 40us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330146.207825:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1788330146.207850:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330146.207853:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330146.208091:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792355712 00000100:00100000:2.0:1788330146.208096:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792355712 00000100:00100000:2.0:1788330146.208129:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788330146.208137:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792355712:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788330146.208228:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec12ac000 x1875199792356480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330146.208240:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792356480:0@lo:400:kworker.0 00000100:00100000:1.0:1788330146.208322:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792355584 00000100:00100000:1.0:1788330146.208327:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792355584 00000100:00100000:1.0:1788330146.208353:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792356096 00000100:00100000:1.0:1788330146.208356:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792356096 00000100:00100000:1.0:1788330146.208378:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792355840 00000100:00100000:1.0:1788330146.208381:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792355840 00000100:00100000:1.0:1788330146.208392:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792356224 00000100:00100000:1.0:1788330146.208394:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792356224 00000100:00100000:1.0:1788330146.208406:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792356736 00000100:00100000:1.0:1788330146.208408:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792356736 00000100:00100000:1.0:1788330146.208419:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792356608 00000100:00100000:1.0:1788330146.208430:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792356608 00000100:00100000:1.0:1788330146.208446:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788330146.208452:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792355584:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788330146.209056:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec12aea00 x1875199792356864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330146.209069:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792356864:0@lo:400:kworker.0 00000100:00100000:3.0:1788330146.209221:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788330146.209233:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792356096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330146.209294:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792356096:12345-0@lo:400:kworker.0 Request processed in 65us (3625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330146.209301:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788330146.209321:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788330146.209328:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792355840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330146.209355:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792355840:12345-0@lo:400:kworker.0 Request processed in 28us (3097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330146.209361:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788330146.209373:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788330146.209380:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792356224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330146.209415:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792356224:12345-0@lo:400:kworker.0 Request processed in 36us (2747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330146.209434:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788330146.209447:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788330146.209454:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792356736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330146.209484:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792356736:12345-0@lo:400:kworker.0 Request processed in 31us (2777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330146.209490:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788330146.209501:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788330146.209508:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792356608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330146.209533:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792356608:12345-0@lo:400:kworker.0 Request processed in 26us (2185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330146.209539:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788330146.209562:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792355456 00000100:00100000:3.0:1788330146.209568:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792355456 00000100:00100000:3.0:1788330146.209600:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788330146.209607:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:3649:x1875199792355456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330146.209638:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:3649:x1875199792355456:12345-0@lo:400:kworker.0 Request processed in 32us (3877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330146.209643:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00010000:00080000:3.0:1788330146.209681:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefe7ed180 x1875199792356224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330146.215215:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792356224:0@lo:400:kworker.0 00010000:00080000:3.0:1788330146.215263:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec12ae300 x1875199792356736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330146.215274:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792356736:0@lo:400:kworker.0 00000100:00100000:3.0:1788330146.215411:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792355840:0@lo:400:kworker.0 00010000:00080000:3.0:1788330146.215423:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fc000 x1875199792356352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330146.215433:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792356352:0@lo:400:kworker.0 00000100:00080000:3.0:1788330146.215471:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788330146.215476:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330146.222667:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792355712:12345-0@lo:400:kworker.0 Request processed in 14518us (16042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330146.222684:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788330146.222775:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792355712:0@lo:400:kworker.0 00010000:00080000:0.0:1788330146.225461:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec12aed80 x1875199792356992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330146.225500:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792356992:0@lo:400:kworker.0 00000100:00100000:0.0:1788330146.225524:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792356608:0@lo:400:kworker.0 00000100:00100000:0.0:1788330146.225535:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792355456:0@lo:400:kworker.0 00000100:00100000:0.0:1788330146.225550:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792356096:0@lo:400:kworker.0 00000100:00100000:1.0:1788330146.227128:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792355584:12345-0@lo:400:kworker.0 Request processed in 18668us (21565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330146.227143:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788330146.227372:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792355584:0@lo:400:kworker.0 00000100:00100000:0.0:1788330146.531083:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330146.531764:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330146.531808:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330146.531838:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330146.532318:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766056448 00000100:00100000:1.0:1788330146.532335:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766056448 00000100:00100000:1.0:1788330146.532404:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 319 00000100:00100000:1.0:1788330146.532415:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+11:2411:x1875199766056448:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330146.533829:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+11:2411:x1875199766056448:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 1406us (2752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330146.533847:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 319 00000100:00100000:2.0:1788330146.535284:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766056704 00000100:00100000:2.0:1788330146.535304:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766056704 00000100:00100000:2.0:1788330146.535386:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766056960 00000100:00100000:2.0:1788330146.535391:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766056960 00000100:00100000:2.0:1788330146.535418:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766056576 00000100:00100000:2.0:1788330146.535422:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766056576 00000100:00100000:2.0:1788330146.535453:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 207 00000100:00100000:3.0:1788330146.535745:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 208 00000100:00100000:3.0:1788330146.535763:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766056960:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330146.535830:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330146.535860:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766056832 00000100:00100000:0.0:1788330146.535864:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766056832 00000100:00100000:0.0:1788330146.535897:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 209 00000100:00100000:0.0:1788330146.535908:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2411:x1875199766056576:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330146.535910:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766056960:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 151us (4115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330146.535924:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 208 00000100:00100000:0.0:1788330146.535950:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2411:x1875199766056576:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 44us (4110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330146.535959:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 209 00000100:00100000:0.0:1788330146.535976:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 210 00000100:00100000:0.0:1788330146.535983:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766056832:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330146.536007:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766056832:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 25us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330146.536013:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 210 00000100:00080000:3.0:1788330146.536584:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788330146.536592:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788330146.536780:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766056704:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330146.536850:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766056704:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 1386us (5088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330146.536859:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 207 00000100:00100000:1.0:1788330146.657775:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330146.657879:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766057088 00000100:00100000:3.0:1788330146.657891:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766057088 00000100:00100000:3.0:1788330146.657956:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 320 00000100:00100000:3.0:1788330146.657966:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef40a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+11:6187:x1875199766057088:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330146.657990:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330146.658019:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef59cba00/0x8475908e9fd0fd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105d93 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330146.658055:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef59cba00/0x8475908e9fd0fd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d93 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330146.658065:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef59cba00/0x8475908e9fd0fd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d93 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330146.658090:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cba00, rc 0) 00000100:00100000:3.0:1788330146.658204:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef40a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+12:6187:x1875199766057088:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 Request processed in 238us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330146.658212:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 320 00000100:00100000:3.0:1788330146.660339:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330146.667225:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766057216 00000100:00100000:0.0:1788330146.667246:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766057216 00000100:00100000:0.0:1788330146.667335:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 321 00000100:00100000:0.0:1788330146.667347:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+12:6187:x1875199766057216:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330146.667584:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+12:6187:x1875199766057216:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 Request processed in 238us (7256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330146.667594:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 321 00000100:00100000:0.0:1788330146.681307:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330146.681459:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766057344 00000100:00100000:3.0:1788330146.681476:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766057344 00000100:00100000:3.0:1788330146.681542:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 322 00000100:00100000:3.0:1788330146.681558:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+12:6187:x1875199766057344:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330146.681803:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+12:6187:x1875199766057344:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 Request processed in 234us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330146.681813:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 322 00000100:00100000:3.0:1788330146.692018:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330146.692604:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766057472 00000100:00100000:1.0:1788330146.692618:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766057472 00000100:00100000:1.0:1788330146.692695:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 323 00000100:00100000:1.0:1788330146.692709:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00beb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+12:6187:x1875199766057472:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330146.692733:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330146.692760:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef6e79400/0x8475908e9fd0fdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105d9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330146.692814:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e79400/0x8475908e9fd0fdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d9a expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330146.692840:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef6e79400/0x8475908e9fd0fdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d9a expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330146.692873:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79400, rc 0) 00000100:00100000:1.0:1788330146.693756:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00beb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:6187:x1875199766057472:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 Request processed in 250us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330146.693768:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 323 00000100:00100000:3.0:1788330146.695034:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330146.698394:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766057600 00000100:00100000:0.0:1788330146.698418:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766057600 00000100:00100000:0.0:1788330146.698653:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 324 00000100:00100000:0.0:1788330146.698668:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00bea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:6187:x1875199766057600:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330146.699459:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00bea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:6187:x1875199766057600:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 Request processed in 787us (4427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330146.699472:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 324 00000100:00100000:0.0:1788330146.709043:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330146.709207:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766057728 00000100:00100000:0.0:1788330146.709219:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766057728 00000100:00100000:0.0:1788330146.709276:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 325 00000100:00100000:0.0:1788330146.709287:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00bea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:6187:x1875199766057728:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330146.709453:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00bea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:6187:x1875199766057728:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 Request processed in 167us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330146.709462:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 325 00010000:00010000:2.0:1788330146.720196:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788330146.910462:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788330146.910475:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eef6de3800 from 7 10000000:01000000:0.0:1788330146.910482:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788330146.910559:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0fe6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330146.910575:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0fe6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330146.910592:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0fe6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330146.910628:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792357120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788330146.910737:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330146.910816:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef4039300 going to sleep for 11 seconds 00000100:00100000:0.0:1788330146.910844:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792357120 00000100:00100000:0.0:1788330146.910853:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792357120 00000100:00100000:0.0:1788330146.910917:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788330146.910930:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792357120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330146.910948:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330146.910963:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef58c2c00/0x8475908e9fd0fed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0fe6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330146.910996:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef58c2c00/0x8475908e9fd0fed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0fe6 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330146.911010:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef58c2c00/0x8475908e9fd0fed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0fe6 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330146.911021:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c2c00, rc 0) 00000100:00100000:0.0:1788330146.911066:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792357120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330146.911074:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788330146.911304:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792357120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330146.911323:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0fe6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0fed expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330146.911333:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0fe6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0fed expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330146.911411:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792357248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330146.911439:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330146.911453:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef4039300 going to sleep for 11 seconds 00000100:00100000:3.0:1788330146.912074:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792357248 00000100:00100000:3.0:1788330146.912084:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792357248 00000100:00100000:3.0:1788330146.912127:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788330146.912137:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792357248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330146.912335:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792357248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330146.912343:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788330146.912533:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792357248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330146.912594:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792357376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330146.912648:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330146.912676:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef4039300 going to sleep for 11 seconds 00000100:00100000:0.0:1788330146.912691:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792357376 00000100:00100000:0.0:1788330146.912695:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792357376 00000100:00100000:0.0:1788330146.912731:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788330146.912740:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792357376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330146.912879:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792357376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330146.912886:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788330146.912928:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792357376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788330146.930580:0:13248:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788330146.932295:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788330146.932353:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788330146.932369:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0fe6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0fed expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330146.932386:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0fe6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0fed expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330146.932399:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788330146.932403:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eefe782800 from 7 10000000:01000000:2.0:1788330146.932406:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788330146.932464:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765a600/0x8475908e9fd0ff4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330146.932473:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99edc765a600/0x8475908e9fd0ff4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330146.932486:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99edc765a600/0x8475908e9fd0ff4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330146.932520:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792357504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788330146.932632:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330146.932688:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc72ebb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788330146.933038:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792357504 00000100:00100000:3.0:1788330146.933050:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792357504 00000100:00100000:3.0:1788330146.933124:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788330146.933189:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792357504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330146.933206:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330146.933222:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef59ca000/0x8475908e9fd0ffb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd0ff4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330146.933253:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef59ca000/0x8475908e9fd0ffb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd0ff4 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330146.933264:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef59ca000/0x8475908e9fd0ffb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0ff4 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330146.933275:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59ca000, rc 0) 00000100:00100000:3.0:1788330146.933336:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792357504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330146.933344:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788330146.933868:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792357504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330146.933968:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99edc765a600/0x8475908e9fd0ff4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ffb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330146.933992:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99edc765a600/0x8475908e9fd0ff4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0ffb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330146.934094:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792357632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330146.934138:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330146.934205:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc72ebb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788330146.934315:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792357632 00000100:00100000:1.0:1788330146.934322:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792357632 00000100:00100000:1.0:1788330146.934362:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788330146.934371:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792357632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330146.934514:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792357632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330146.934523:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788330146.934560:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792357632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330146.934603:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792357760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330146.934647:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330146.934666:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc772da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788330146.934676:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792357760 00000100:00100000:1.0:1788330146.934679:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792357760 00000100:00100000:1.0:1788330146.934697:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788330146.934703:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792357760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330146.935117:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792357760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 411us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330146.935125:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788330146.935246:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792357760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788330146.937337:0:13250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788330146.942356:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788330146.942415:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788330146.942431:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765a600/0x8475908e9fd0ff4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ffb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330146.942446:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99edc765a600/0x8475908e9fd0ff4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ffb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330146.945666:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788330146.945679:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eef59c6800 from 7 10000000:01000000:0.0:1788330146.945687:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788330146.945753:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd1002 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330146.945773:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd1002 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330146.945800:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd1002 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330146.945837:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792357888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788330146.946024:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330146.946084:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef4039300 going to sleep for 11 seconds 00000100:00100000:2.0:1788330146.946191:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792357888 00000100:00100000:2.0:1788330146.946202:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792357888 00000100:00100000:2.0:1788330146.946268:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788330146.946280:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792357888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330146.946300:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330146.946317:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99edc765ba00/0x8475908e9fd1009 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd1002 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330146.946348:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99edc765ba00/0x8475908e9fd1009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd1002 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330146.946362:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99edc765ba00/0x8475908e9fd1009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd1002 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330146.946375:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99edc765ba00, rc 0) 00000100:00100000:2.0:1788330146.946431:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792357888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330146.946439:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788330146.946559:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792357888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330146.946580:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd1002 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1009 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330146.946591:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd1002 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd1009 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330146.946682:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792358016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330146.946716:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330146.946749:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef4039300 going to sleep for 11 seconds 00000100:00100000:2.0:1788330146.946806:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792358016 00000100:00100000:2.0:1788330146.946811:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792358016 00000100:00100000:2.0:1788330146.946854:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788330146.946861:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792358016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330146.947130:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792358016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330146.947139:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788330146.947230:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792358016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330146.947263:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792358144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330146.947307:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330146.947332:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef4039300 going to sleep for 11 seconds 00000100:00100000:2.0:1788330146.947525:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792358144 00000100:00100000:2.0:1788330146.947530:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792358144 00000100:00100000:2.0:1788330146.947562:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788330146.947571:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792358144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330146.947666:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792358144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330146.947672:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788330146.947770:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792358144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788330146.949320:0:13252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788330146.949537:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788330146.949581:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788330146.949596:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd1002 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1009 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330146.949609:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd1002 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1009 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330146.949622:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788330146.949625:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eec865b000 from 7 10000000:01000000:1.0:1788330146.949628:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788330146.949674:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd1010 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330146.949683:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd1010 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330146.949695:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd1010 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330146.949723:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792358272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788330146.949812:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330146.949873:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc772da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788330146.951026:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792358272 00000100:00100000:0.0:1788330146.951040:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792358272 00000100:00100000:0.0:1788330146.951106:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788330146.951119:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792358272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330146.951136:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330146.951171:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef58c3a00/0x8475908e9fd1017 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd1010 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330146.951205:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef58c3a00/0x8475908e9fd1017 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd1010 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330146.951218:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef58c3a00/0x8475908e9fd1017 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd1010 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330146.951229:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef58c3a00, rc 0) 00000100:00100000:0.0:1788330146.951302:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792358272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330146.951310:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788330146.951687:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792358272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330146.951711:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd1010 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1017 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330146.951722:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd1010 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd1017 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330146.951826:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792358400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330146.951869:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330146.951981:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792358400 00000100:00100000:0.0:1788330146.951987:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792358400 00000100:00100000:0.0:1788330146.952019:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788330146.952027:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792358400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330146.952910:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792358400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 878us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330146.952922:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788330146.953492:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc772da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788330146.953523:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792358400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330146.953586:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792358528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330146.953655:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330146.953672:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc772da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788330146.953745:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792358528 00000100:00100000:0.0:1788330146.953753:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792358528 00000100:00100000:0.0:1788330146.953819:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1788330146.953830:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792358528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330146.953980:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792358528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330146.953988:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788330146.954066:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792358528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788330146.954948:0:13253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788330146.959082:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788330146.959144:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788330146.959180:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd1010 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1017 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330146.959196:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd1010 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1017 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330147.748850:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330148.255082:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792358656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330148.255226:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330148.255939:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792358784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330148.255995:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330148.256975:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792358656 00000100:00100000:3.0:1788330148.256990:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792358656 00000100:00100000:3.0:1788330148.257082:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788330148.257098:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792358656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330148.257176:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330148.257290:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792358656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 198us (2065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330148.257298:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788330148.257331:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792358784 00000100:00100000:3.0:1788330148.257336:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792358784 00000100:00100000:3.0:1788330148.257369:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788330148.257376:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792358784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788330148.257411:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788330148.257457:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792358784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330148.257463:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788330148.257527:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792358784:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1788330148.257571:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec12aca80 x1875199792358656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330164 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330148.257588:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792358656:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788330148.257698:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330148.258808:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330148.258842:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792358912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788330148.258915:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330148.258973:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792358912 00000100:00100000:3.0:1788330148.258981:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792358912 00000100:00100000:3.0:1788330148.259035:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788330148.259045:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792358912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788330148.259070:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330148.259116:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792358912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330148.259137:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1788330148.259190:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788330148.259222:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6d43100 x1875199792358912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330164 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330148.259240:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792358912:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788330148.764264:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330149.789227:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792359040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330149.789341:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330149.789458:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792359040 00000100:00100000:3.0:1788330149.789469:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792359040 00000100:00100000:3.0:1788330149.789542:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788330149.789553:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792359040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330149.789597:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330149.789652:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792359040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330149.789660:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1788330149.789686:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788330149.789728:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6d43100 x1875199792359040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330149.789752:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792359040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330149.791130:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792359168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330149.791290:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330149.793129:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330149.798579:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792359168 00000100:00100000:0.0:1788330149.798602:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792359168 00000100:00080000:3.0:1788330149.798774:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330149.799432:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788330149.799451:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792359168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788330149.799490:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330149.799621:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792359168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 177us (8330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330149.799630:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1788330149.799922:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7799180 x1875199792359168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330149.799967:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792359168:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1788330150.437096:0:13392:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788330150.812774:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330150.812801:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330150.812831:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792359296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330150.812941:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330150.813540:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792359296 00000100:00100000:3.0:1788330150.813555:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792359296 00000100:00100000:3.0:1788330150.813629:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788330150.813643:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792359296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788330150.813694:0:7831:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788330150.813793:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792359296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330150.813802:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788330150.814054:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792359296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330151.324098:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792359424:0@lo:400:kworker.0 00000100:00100000:1.0:1788330151.324232:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330151.324361:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330151.324368:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792359808:0@lo:400:kworker.0 00000100:00100000:1.0:1788330151.324400:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330151.324442:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792359936:0@lo:400:kworker.0 00000100:00100000:1.0:1788330151.324490:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330151.324544:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330151.324550:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792360320:0@lo:400:kworker.0 00000100:00100000:1.0:1788330151.324577:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330151.324616:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792360448:0@lo:400:kworker.0 00000100:00100000:1.0:1788330151.324639:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330151.324693:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330151.324699:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792360832:0@lo:400:kworker.0 00000100:00100000:1.0:1788330151.324723:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330151.324781:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792360960:0@lo:400:kworker.0 00000100:00100000:1.0:1788330151.324825:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330151.325004:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792360320 00000100:00100000:2.0:1788330151.325015:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792360320 00000100:00100000:2.0:1788330151.325074:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792360448 00000100:00100000:2.0:1788330151.325079:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792360448 00000100:00100000:2.0:1788330151.325096:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792360832 00000100:00100000:2.0:1788330151.325099:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792360832 00000100:00100000:2.0:1788330151.325113:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792360960 00000100:00100000:2.0:1788330151.325115:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792360960 00000100:00100000:2.0:1788330151.325134:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788330151.325145:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792360320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330151.326122:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792359552:0@lo:400:kworker.0 00000100:00100000:3.0:1788330151.326196:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330151.326225:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792360064:0@lo:400:kworker.0 00000100:00100000:3.0:1788330151.326243:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330151.326260:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792360576:0@lo:400:kworker.0 00000100:00100000:3.0:1788330151.326277:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330151.326302:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788330151.326308:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792359680:0@lo:400:kworker.0 00000100:00100000:3.0:1788330151.326330:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330151.326344:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792360192:0@lo:400:kworker.0 00000100:00100000:3.0:1788330151.326363:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330151.326374:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792360704:0@lo:400:kworker.0 00000100:00100000:3.0:1788330151.326392:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330151.326419:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792359808 00000100:00100000:3.0:1788330151.326425:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792359808 00000100:00100000:3.0:1788330151.326472:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792359552 00000100:00100000:3.0:1788330151.326475:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792359552 00000100:00100000:3.0:1788330151.326486:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792360064 00000100:00100000:3.0:1788330151.326489:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792360064 00000100:00100000:3.0:1788330151.326504:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792360576 00000100:00100000:3.0:1788330151.326506:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792360576 00000100:00100000:3.0:1788330151.326516:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792360192 00000100:00100000:3.0:1788330151.326518:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792360192 00000100:00100000:3.0:1788330151.326530:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792360704 00000100:00100000:3.0:1788330151.326532:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792360704 00000100:00100000:3.0:1788330151.326546:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788330151.326554:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792359808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330151.326645:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788330151.326655:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792359552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330151.326694:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792359552:12345-0@lo:400:kworker.0 Request processed in 42us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330151.326701:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788330151.326722:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788330151.326727:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792360064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330151.326759:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792360064:12345-0@lo:400:kworker.0 Request processed in 32us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330151.326765:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788330151.326776:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788330151.326781:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792360576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330151.326803:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792360576:12345-0@lo:400:kworker.0 Request processed in 22us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330151.326818:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788330151.326829:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788330151.326834:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792360192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330151.328007:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792360192:12345-0@lo:400:kworker.0 Request processed in 1165us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330151.328020:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788330151.328049:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788330151.328059:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792360704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330151.328098:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792360704:12345-0@lo:400:kworker.0 Request processed in 43us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330151.328104:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788330151.328233:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792359424 00000100:00100000:0.0:1788330151.328242:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792359424 00000100:00100000:0.0:1788330151.328290:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788330151.328297:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792359424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330151.328389:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788330151.328398:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792360448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330151.331491:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792360320:12345-0@lo:400:kworker.0 Request processed in 6329us (6894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330151.331531:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788330151.331584:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788330151.331602:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792360832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330151.332592:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792359808:12345-0@lo:400:kworker.0 Request processed in 6028us (8181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330151.332610:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788330151.332679:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792359936 00000100:00100000:3.0:1788330151.332693:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792359936 00000100:00100000:3.0:1788330151.332766:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792359680 00000100:00100000:3.0:1788330151.332770:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792359680 00000100:00100000:3.0:1788330151.332792:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788330151.332800:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792359936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330151.334316:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792359936:12345-0@lo:400:kworker.0 Request processed in 1506us (9815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330151.334335:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788330151.334373:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788330151.334388:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792359680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330151.334452:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792359680:12345-0@lo:400:kworker.0 Request processed in 71us (8121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330151.334458:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788330151.334506:0:8440:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788330151.334516:0:8440:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788330151.334589:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792359680:0@lo:400:kworker.0 00010000:00080000:3.0:1788330151.334609:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7db2d80 x1875199792360192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330151.334622:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792360192:0@lo:400:kworker.0 00010000:00080000:3.0:1788330151.334639:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7db3b80 x1875199792360704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330151.334648:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792360704:0@lo:400:kworker.0 00000100:00100000:3.0:1788330151.334666:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792359552:0@lo:400:kworker.0 00000100:00100000:3.0:1788330151.334683:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792360064:0@lo:400:kworker.0 00000100:00100000:3.0:1788330151.334698:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792360576:0@lo:400:kworker.0 00000100:00080000:3.0:1788330151.335102:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788330151.335110:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788330151.335114:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330151.335118:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330151.335130:0:8632:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788330151.335144:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788330151.335202:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792360960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330151.335393:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792360960:12345-0@lo:400:kworker.0 Request processed in 194us (10566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330151.335401:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1788330151.335714:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef58ca680 x1875199792360960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330151.335751:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792360960:0@lo:400:kworker.0 00000100:00100000:0.0:1788330151.335845:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792359424:12345-0@lo:400:kworker.0 Request processed in 7545us (11611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330151.335867:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788330151.337233:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792360448:12345-0@lo:400:kworker.0 Request processed in 8824us (12581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330151.337726:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788330151.338063:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792360832:12345-0@lo:400:kworker.0 Request processed in 6466us (13334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330151.338073:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:3.0:1788330151.338209:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc18e00 x1875199792360832/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330151.338228:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792360832:0@lo:400:kworker.0 00010000:00080000:3.0:1788330151.344539:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7db2680 x1875199792360448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330151.344568:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792360448:0@lo:400:kworker.0 00010000:00080000:3.0:1788330151.344596:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7db1180 x1875199792360320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330151.344604:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792360320:0@lo:400:kworker.0 00000100:00100000:3.0:1788330151.344624:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792359936:0@lo:400:kworker.0 00000100:00100000:3.0:1788330151.344641:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792359808:0@lo:400:kworker.0 00000100:00100000:3.0:1788330151.344657:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792359424:0@lo:400:kworker.0 00000100:00100000:1.0:1788330151.658030:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330151.658081:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330151.658104:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330151.658120:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330151.658171:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330151.658215:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766058112 00000100:00100000:1.0:1788330151.658235:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766058112 00000100:00100000:1.0:1788330151.658336:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766058368 00000100:00100000:1.0:1788330151.658341:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766058368 00000100:00100000:1.0:1788330151.658355:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766057984 00000100:00100000:1.0:1788330151.658368:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766057984 00000100:00100000:1.0:1788330151.658390:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766058240 00000100:00100000:1.0:1788330151.658392:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766058240 00000100:00100000:1.0:1788330151.658411:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 217 00000100:00100000:1.0:1788330151.658424:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766058112:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330151.658554:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766058112:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 132us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330151.658564:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 217 00000100:00100000:1.0:1788330151.658588:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 218 00000100:00100000:1.0:1788330151.658594:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766058368:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330151.658640:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766058368:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 46us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330151.658648:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 218 00000100:00100000:1.0:1788330151.658660:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 219 00000100:00100000:1.0:1788330151.658667:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766057984:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330151.658692:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766057984:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 25us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330151.658697:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 219 00000100:00100000:1.0:1788330151.658707:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 220 00000100:00100000:1.0:1788330151.658714:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766058240:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330151.658736:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766058240:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 23us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330151.658755:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 220 00000100:00080000:1.0:1788330151.658792:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788330151.658799:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788330151.659214:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766057856 00000100:00100000:2.0:1788330151.659224:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766057856 00000100:00100000:2.0:1788330151.659280:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 339 00000100:00100000:2.0:1788330151.659291:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2410:x1875199766057856:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330151.659335:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2410:x1875199766057856:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 47us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330151.659344:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 339 00010000:00010000:2.0:1788330151.840581:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330152.860462:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330153.372118:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330153.372177:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792361088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788330153.372288:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330153.372394:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792361088 00000100:00100000:3.0:1788330153.372405:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792361088 00000100:00100000:3.0:1788330153.372478:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788330153.372491:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792361088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788330153.372531:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330153.372972:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788330153.372992:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792361344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330153.373049:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330153.373114:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792361216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330153.373175:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330153.373214:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792361216 00000100:00100000:2.0:1788330153.373220:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792361216 00000100:00100000:2.0:1788330153.373269:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788330153.373277:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792361216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788330153.373344:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788330153.373420:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792361216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330153.373429:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788330153.373501:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792361216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330153.373621:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792361344 00000100:00100000:0.0:1788330153.373626:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792361344 00000100:00100000:0.0:1788330153.373668:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788330153.373685:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792361344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788330153.373703:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330153.373766:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792361344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330153.373774:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1788330153.373812:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec12adc00 x1875199792361344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330153.373830:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792361344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330153.374405:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792361088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1915us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330153.374415:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1788330153.374637:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788330153.374737:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc18e00 x1875199792361088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330153.374758:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792361088:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788330153.885658:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330154.908861:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330154.909331:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330154.909362:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792361472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330154.909580:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330154.909662:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792361472 00000100:00100000:2.0:1788330154.909673:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792361472 00000100:00100000:2.0:1788330154.909831:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788330154.909845:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792361472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330154.909888:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330154.909944:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792361472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330154.909951:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1788330154.909979:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788330154.910016:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec12ad500 x1875199792361472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330154.910040:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792361472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330154.910330:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792361600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330154.910374:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330154.910918:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792361600 00000100:00100000:2.0:1788330154.910929:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792361600 00000100:00100000:2.0:1788330154.910988:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788330154.911012:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792361600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788330154.911031:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788330154.911097:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330154.911198:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792361600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 187us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330154.911206:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:3.0:1788330154.911328:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec12ebb80 x1875199792361600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330154.911347:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792361600:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788330155.932132:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330155.932396:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792361728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788330155.932497:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330155.934958:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792361728 00000100:00100000:3.0:1788330155.934978:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792361728 00000100:00100000:3.0:1788330155.935057:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788330155.935070:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792361728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788330155.935120:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788330155.935262:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792361728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 194us (2765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330155.935285:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788330155.937068:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792361728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330156.447418:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792362112:0@lo:400:kworker.0 00000100:00100000:0.0:1788330156.447517:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330156.447585:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792362624:0@lo:400:kworker.0 00000100:00100000:0.0:1788330156.447610:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330156.447644:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792363136:0@lo:400:kworker.0 00000100:00100000:0.0:1788330156.447664:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330156.447692:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788330156.447709:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792362240:0@lo:400:kworker.0 00000100:00100000:3.0:1788330156.447844:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792362624 00000100:00100000:3.0:1788330156.447855:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792362624 00000100:00100000:3.0:1788330156.447917:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792363136 00000100:00100000:3.0:1788330156.447920:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792363136 00000100:00100000:0.0:1788330156.447957:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330156.451922:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788330156.451922:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792361856:0@lo:400:kworker.0 00000100:00100000:3.0:1788330156.451963:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792362624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330156.452065:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792362752:0@lo:400:kworker.0 00000100:00100000:1.0:1788330156.452128:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792361984:0@lo:400:kworker.0 00000100:00100000:2.0:1788330156.452555:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330156.452616:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330156.452682:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792363264:0@lo:400:kworker.0 00000100:00100000:0.0:1788330156.452722:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330156.452847:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330156.452863:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792362496:0@lo:400:kworker.0 00000100:00100000:1.0:1788330156.452884:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330156.452899:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792363008:0@lo:400:kworker.0 00000100:00100000:1.0:1788330156.452917:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330156.453191:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792362112 00000100:00100000:0.0:1788330156.453212:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792362112 00000100:00100000:0.0:1788330156.453273:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788330156.453282:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792362112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330156.453464:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792362112:12345-0@lo:400:kworker.0 Request processed in 54us (5820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330156.453473:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788330156.453502:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792362240 00000100:00100000:0.0:1788330156.453506:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792362240 00000100:00100000:0.0:1788330156.453524:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792361984 00000100:00100000:0.0:1788330156.453526:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792361984 00000100:00100000:0.0:1788330156.453536:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792362496 00000100:00100000:0.0:1788330156.453538:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792362496 00000100:00100000:0.0:1788330156.453552:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792363008 00000100:00100000:0.0:1788330156.453554:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792363008 00000100:00100000:0.0:1788330156.453566:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788330156.453574:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792363136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330156.453609:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792363136:12345-0@lo:400:kworker.0 Request processed in 35us (5943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330156.453615:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788330156.453628:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788330156.453634:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792362240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330156.453658:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792362240:12345-0@lo:400:kworker.0 Request processed in 25us (5926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330156.453664:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788330156.453673:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788330156.453678:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792361984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330156.453814:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792361984:12345-0@lo:400:kworker.0 Request processed in 134us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330156.453830:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788330156.453842:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788330156.453848:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792362496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330156.453874:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792362496:12345-0@lo:400:kworker.0 Request processed in 27us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330156.453880:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788330156.453889:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788330156.453894:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792363008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330156.453915:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792363008:12345-0@lo:400:kworker.0 Request processed in 21us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330156.453920:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788330156.453944:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792361856 00000100:00100000:0.0:1788330156.453948:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792361856 00000100:00100000:0.0:1788330156.453978:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788330156.453985:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3646:x1875199792361856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330156.454014:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3646:x1875199792361856:12345-0@lo:400:kworker.0 Request processed in 31us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330156.454021:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788330156.454051:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792362752 00000100:00100000:0.0:1788330156.454055:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792362752 00000100:00100000:0.0:1788330156.454089:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792363264 00000100:00100000:0.0:1788330156.454092:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792363264 00000100:00100000:0.0:1788330156.454109:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788330156.454115:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792362752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330156.454145:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792362752:12345-0@lo:400:kworker.0 Request processed in 30us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330156.454180:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788330156.454191:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788330156.454197:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792363264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330156.454224:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792363264:12345-0@lo:400:kworker.0 Request processed in 27us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330156.454229:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788330156.455495:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792362624:12345-0@lo:400:kworker.0 Request processed in 3544us (7873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330156.455510:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:3.0:1788330156.455550:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330156.455555:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330156.455567:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788330156.455570:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788330156.455626:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7799180 x1875199792362624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330156.455646:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792362624:0@lo:400:kworker.0 00010000:00080000:3.0:1788330156.455662:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc6605500 x1875199792363136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330156.455671:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792363136:0@lo:400:kworker.0 00000100:00100000:3.0:1788330156.455723:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792362240:0@lo:400:kworker.0 00010000:00080000:3.0:1788330156.455744:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc6605c00 x1875199792362752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330156.455754:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792362752:0@lo:400:kworker.0 00010000:00080000:3.0:1788330156.455767:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7696d80 x1875199792363264/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330156.455774:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792363264:0@lo:400:kworker.0 00000100:00100000:3.0:1788330156.455787:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792362112:0@lo:400:kworker.0 00000100:00100000:1.0:1788330156.457898:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792361984:0@lo:400:kworker.0 00000100:00100000:1.0:1788330156.457922:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792362496:0@lo:400:kworker.0 00000100:00100000:1.0:1788330156.457935:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792363008:0@lo:400:kworker.0 00000100:00100000:2.0:1788330156.471719:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792361856:0@lo:400:kworker.0 00000100:00100000:2.0:1788330156.471745:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792362368:0@lo:400:kworker.0 00000100:00100000:2.0:1788330156.471835:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330156.471889:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792362880:0@lo:400:kworker.0 00000100:00100000:2.0:1788330156.471921:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330156.471959:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792363392:0@lo:400:kworker.0 00000100:00100000:2.0:1788330156.471986:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330156.472060:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792362368 00000100:00100000:3.0:1788330156.472072:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792362368 00000100:00100000:0.0:1788330156.472080:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792362880 00000100:00100000:0.0:1788330156.472086:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792362880 00000100:00100000:0.0:1788330156.472143:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792363392 00000100:00100000:3.0:1788330156.472144:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788330156.472147:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792363392 00000100:00100000:3.0:1788330156.472189:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792362368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330156.472196:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788330156.472206:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792362880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330156.472275:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788330156.472287:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792363392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330156.472433:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792362880:12345-0@lo:400:kworker.0 Request processed in 229us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330156.472442:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1788330156.472467:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330156.472472:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330156.485354:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792362368:12345-0@lo:400:kworker.0 Request processed in 13154us (13503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330156.485391:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788330156.494464:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792362368:0@lo:400:kworker.0 00010000:00080000:2.0:1788330156.494491:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc6605f80 x1875199792362880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330156.494503:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792362880:0@lo:400:kworker.0 00000100:00100000:0.0:1788330156.498363:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792363392:12345-0@lo:400:kworker.0 Request processed in 26064us (26361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330156.498384:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1788330156.498579:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7695180 x1875199792363392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330156.498597:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792363392:0@lo:400:kworker.0 00000100:00100000:2.0:1788330156.776449:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330156.776501:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330156.776536:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330156.776555:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766058624 00000100:00100000:3.0:1788330156.776569:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766058624 00000100:00100000:2.0:1788330156.776570:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330156.776607:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330156.776635:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766058880 00000100:00100000:2.0:1788330156.776641:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766058880 00000100:00100000:3.0:1788330156.776648:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766058752 00000100:00100000:3.0:1788330156.776653:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766058752 00000100:00100000:2.0:1788330156.776675:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766059008 00000100:00100000:2.0:1788330156.776681:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766059008 00000100:00100000:3.0:1788330156.776685:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 227 00000100:00100000:3.0:1788330156.776710:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766058624:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330156.776722:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 228 00000100:00100000:2.0:1788330156.776733:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766058880:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330156.776804:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766058496 00000100:00100000:1.0:1788330156.776809:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766058496 00000100:00100000:2.0:1788330156.776814:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766058880:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 81us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330156.776823:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 228 00000100:00100000:1.0:1788330156.776863:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 341 00000100:00100000:1.0:1788330156.776870:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2410:x1875199766058496:12345-192.168.202.50@tcp:400:kworker.0 00000100:00080000:0.0:1788330156.777109:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788330156.777115:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330156.777260:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 229 00000100:00100000:2.0:1788330156.777275:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766058752:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330156.777497:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766058624:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 790us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330156.777506:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 227 00000100:00100000:3.0:1788330156.777529:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 230 00000100:00100000:3.0:1788330156.777536:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766059008:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330156.777560:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766059008:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 26us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330156.777566:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 230 00000100:00100000:0.0:1788330156.786985:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2410:x1875199766058496:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 10097us (10431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330156.787005:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 341 00000100:00100000:2.0:1788330156.791748:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766058752:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 14454us (15154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330156.791771:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 229 00000001:02000400:3.0:1788330156.867477:0:13543:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 02:22:34 (1788330154) === 00010000:00010000:1.0:1788330156.955421:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330157.322653:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330157.322861:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766059264 00000100:00100000:3.0:1788330157.322875:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766059264 00000100:00100000:3.0:1788330157.322976:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:3.0:1788330157.322989:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:10510:x1875199766059264:12345-192.168.202.50@tcp:700:mkdir.0 00000100:00100000:3.0:1788330157.323119:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:10510:x1875199766059264:12345-192.168.202.50@tcp:700:mkdir.0 Request processed in 132us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330157.323128:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:2.0:1788330157.327787:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330157.328747:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766059136 00000100:00100000:3.0:1788330157.328763:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766059136 00000100:00100000:3.0:1788330157.328842:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:3.0:1788330157.328854:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2411:x1875199766059136:12345-192.168.202.50@tcp:41:mkdir.0 00000004:00000024:3.0:1788330157.328922:0:6522:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788330157.329320:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2411:x1875199766059136:12345-192.168.202.50@tcp:41:mkdir.0 Request processed in 465us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330157.329330:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:0.0:1788330157.330000:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330157.330262:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766059520 00000100:00100000:2.0:1788330157.330273:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766059520 00000100:00100000:2.0:1788330157.330321:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:2.0:1788330157.330330:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:10510:x1875199766059520:12345-192.168.202.50@tcp:36:mkdir.0 00010000:00010000:2.0:1788330157.330407:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330157.330614:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd0ec0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d0e expref: 6 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.330668:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecda4d500) 00010000:00010000:2.0:1788330157.330682:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330157.330811:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd101e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.330826:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd101e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.330844:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd101e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.330897:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1025 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.330905:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1025 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.330923:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1025 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.332279:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd102c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.332298:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd102c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.332308:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd102c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330157.332325:0:6524:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000dbad0f6c reply state 0000000063dac908 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd102c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.332349:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd102c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.332357:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99edc10b4600) 00010000:00010000:2.0:1788330157.332360:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788330157.332364:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788330157.332371:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788330157.332380:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd101e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.332387:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd101e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.332394:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd101e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.332401:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765a000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330157.332405:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd101e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.332413:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd101e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.332422:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99edc10b4700) 00010000:00010000:2.0:1788330157.332424:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330157.332427:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd101e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.332434:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd101e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330157.332452:0:6524:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000dbad0f6c reply state 0000000063dac908 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1025 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.332466:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1025 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.332473:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99edc10b4000) 00010000:00010000:2.0:1788330157.332476:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788330157.332478:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788330157.332591:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:10510:x1875199766059520:12345-192.168.202.50@tcp:36:mkdir.0 Request processed in 2258us (2590us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788330157.332600:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:0.0:1788330157.373406:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330157.373750:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766059648 00000100:00100000:2.0:1788330157.373773:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766059648 00000100:00100000:2.0:1788330157.373855:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:2.0:1788330157.373877:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:10512:x1875199766059648:12345-192.168.202.50@tcp:101:chmod.0 00010000:00010000:2.0:1788330157.373902:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330157.373943:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1033 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105da1 expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.374014:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b200/0x8475908e9fd103a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.374029:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b200/0x8475908e9fd103a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.374040:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b200/0x8475908e9fd103a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330157.374086:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788330157.374090:0:7832:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330157.374130:0:7832:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b200/0x8475908e9fd103a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.374216:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1033 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105da1 expref: 9 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.374234:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b200/0x8475908e9fd103a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105da1 expref: 8 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.374243:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99edc10b4700) 00010000:00010000:2.0:1788330157.374246:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330157.374249:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99edc765b200, rc 0) 00000100:00100000:2.0:1788330157.374322:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:10512:x1875199766059648:12345-192.168.202.50@tcp:101:chmod.0 Request processed in 455us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330157.374331:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:0.0:1788330157.383028:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330157.385267:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766059904 00000100:00100000:3.0:1788330157.385284:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766059904 00000100:00100000:3.0:1788330157.385380:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:3.0:1788330157.385393:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:10512:x1875199766059904:12345-192.168.202.50@tcp:36:chmod.0 00010000:00010000:3.0:1788330157.385591:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330157.385620:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b200/0x8475908e9fd103a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105da1 expref: 8 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.385641:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99edc10b4700) 00010000:00010000:3.0:1788330157.386274:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330157.386309:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1041 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.386323:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1041 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.386334:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1041 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330157.386657:0:6522:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000e367f56 reply state 0000000024459866 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1041 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.386670:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1041 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.386700:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eefe73fe00) 00010000:00010000:3.0:1788330157.386703:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788330157.386706:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788330157.386714:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788330157.387228:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:10512:x1875199766059904:12345-192.168.202.50@tcp:36:chmod.0 Request processed in 1834us (4208us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788330157.387237:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:3.0:1788330157.440362:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330157.444259:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766060032 00000100:00100000:2.0:1788330157.444276:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766060032 00000100:00100000:2.0:1788330157.444364:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00100000:2.0:1788330157.444375:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:10514:x1875199766060032:12345-192.168.202.50@tcp:101:chown.0 00010000:00010000:2.0:1788330157.444401:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330157.444421:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1048 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105da8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.444492:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a400/0x8475908e9fd104f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.444506:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a400/0x8475908e9fd104f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.444518:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a400/0x8475908e9fd104f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330157.444585:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788330157.444588:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330157.444628:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a400/0x8475908e9fd104f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.444935:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1048 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105da8 expref: 11 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.444955:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a400/0x8475908e9fd104f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105da8 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.444963:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eefe73fe00) 00010000:00010000:2.0:1788330157.444966:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330157.444970:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99edc765a400, rc 0) 00000100:00100000:2.0:1788330157.445042:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+10:10514:x1875199766060032:12345-192.168.202.50@tcp:101:chown.0 Request processed in 667us (4696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330157.445050:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00100000:0.0:1788330157.447765:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330157.447973:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766060160 00000100:00100000:2.0:1788330157.447983:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766060160 00000100:00100000:2.0:1788330157.448044:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:2.0:1788330157.448054:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+10:10514:x1875199766060160:12345-192.168.202.50@tcp:101:chown.0 00010000:00010000:2.0:1788330157.448073:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330157.448090:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765be00/0x8475908e9fd1056 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105daf expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448184:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765bc00/0x8475908e9fd105d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448231:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765bc00/0x8475908e9fd105d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448243:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765bc00/0x8475908e9fd105d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448257:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b400/0x8475908e9fd1064 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448263:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b400/0x8475908e9fd1064 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448271:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b400/0x8475908e9fd1064 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448344:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b800/0x8475908e9fd106b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448352:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b800/0x8475908e9fd106b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448358:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b800/0x8475908e9fd106b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330157.448396:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788330157.448400:0:7832:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330157.448418:0:7832:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b800/0x8475908e9fd106b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448430:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765bc00/0x8475908e9fd105d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448446:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765bc00/0x8475908e9fd105d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448453:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765bc00/0x8475908e9fd105d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448459:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765bc00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330157.448463:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765bc00/0x8475908e9fd105d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448471:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765bc00/0x8475908e9fd105d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448484:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eefe73fe00) 00010000:00010000:2.0:1788330157.448487:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330157.448492:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765bc00/0x8475908e9fd105d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448497:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765bc00/0x8475908e9fd105d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448512:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b400/0x8475908e9fd1064 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448518:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b400/0x8475908e9fd1064 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448524:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b400/0x8475908e9fd1064 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448529:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765b400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330157.448539:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b400/0x8475908e9fd1064 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448544:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b400/0x8475908e9fd1064 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448552:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99edc10b4000) 00010000:00010000:2.0:1788330157.448554:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330157.448557:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b400/0x8475908e9fd1064 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448562:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b400/0x8475908e9fd1064 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448603:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765be00/0x8475908e9fd1056 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105daf expref: 12 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448616:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b800/0x8475908e9fd106b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105daf expref: 11 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.448623:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99edc10b4600) 00010000:00010000:2.0:1788330157.448625:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330157.448628:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99edc765b800, rc 0) 00000100:00100000:2.0:1788330157.448709:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+11:10514:x1875199766060160:12345-192.168.202.50@tcp:101:chown.0 Request processed in 656us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330157.448717:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:0.0:1788330157.457506:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330157.457765:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766060288 00000100:00100000:1.0:1788330157.457776:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766060288 00000100:00100000:1.0:1788330157.457836:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:1.0:1788330157.457847:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+11:10514:x1875199766060288:12345-192.168.202.50@tcp:900:chown.0 00000100:00100000:1.0:1788330157.458694:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+11:10514:x1875199766060288:12345-192.168.202.50@tcp:900:chown.0 Request processed in 838us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330157.458723:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:0.0:1788330157.465292:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330157.465713:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766060544 00000100:00100000:3.0:1788330157.465737:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766060544 00000100:00100000:3.0:1788330157.465818:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:3.0:1788330157.465832:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+11:10514:x1875199766060544:12345-192.168.202.50@tcp:36:chown.0 00010000:00010000:3.0:1788330157.465923:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330157.465960:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b800/0x8475908e9fd106b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105daf expref: 11 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.465983:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99edc10b4600) 00010000:00010000:3.0:1788330157.465989:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330157.466021:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1072 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.466038:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1072 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.466050:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1072 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788330157.474042:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:3.0:1788330157.474283:0:6522:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e8d119a6 reply state 00000000f52cdfbd transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1072 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.474327:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1072 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.474338:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99edc10b4600) 00010000:00010000:3.0:1788330157.474341:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788330157.474348:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788330157.474369:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1788330157.474526:0:6522:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788330157.474550:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:10514:x1875199766060544:12345-192.168.202.50@tcp:36:chown.0 Request processed in 8713us (9266us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788330157.474560:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 28 00010000:00010000:0.0:1788330157.474734:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1025 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.474745:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1025 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.474753:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1025 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.474759:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765a200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330157.474764:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1025 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.474773:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1025 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.474789:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99edc10b4000) 00010000:00010000:0.0:1788330157.474792:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330157.474796:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1025 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.474801:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1025 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.474825:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd102c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.474843:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd102c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.474860:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd102c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.474865:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765aa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330157.474869:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd102c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.474875:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd102c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.474884:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99edc10b4600) 00010000:00010000:0.0:1788330157.474887:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330157.474890:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd102c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.474895:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd102c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.474909:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1041 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.474915:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1041 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.474922:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1041 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.474927:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330157.474937:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1041 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.474944:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1041 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.474954:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eefe73fe00) 00010000:00010000:0.0:1788330157.474956:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788330157.474959:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1041 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.474965:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1041 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.477483:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1072 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.477502:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1072 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.477510:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1072 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.477516:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59ca600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330157.477522:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1072 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.477529:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1072 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.477550:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99edc10b4600) 00010000:00010000:1.0:1788330157.477554:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788330157.477559:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1072 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.477565:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1072 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330157.508107:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330157.508875:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766060672 00000100:00100000:1.0:1788330157.508892:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766060672 00000100:00100000:1.0:1788330157.508975:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 29 00000100:00100000:1.0:1788330157.508986:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:10515:x1875199766060672:12345-192.168.202.50@tcp:101:touch.500 00010000:00010000:1.0:1788330157.509010:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330157.509047:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1079 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105db6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788330157.514029:0:6523:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4926us 00010000:00010000:3.0:1788330157.590374:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd1080 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.590408:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd1080 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.590425:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd1080 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.590443:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1087 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.590451:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.590457:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.590665:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd108e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.590674:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd108e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.590682:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd108e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330157.590804:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788330157.590810:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788330157.590937:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd108e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.590952:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd1080 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.590959:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd1080 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.590966:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd1080 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.590973:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59ca200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330157.590978:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd1080 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.590987:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd1080 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.591001:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eefe73fe00) 00010000:00010000:3.0:1788330157.591012:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330157.591019:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd1080 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.591026:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd1080 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.591040:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1087 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.591047:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1087 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.591053:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1087 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.591058:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59caa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330157.591061:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1087 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.591068:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1087 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.591075:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99eefe73ff00) 00010000:00010000:3.0:1788330157.591078:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330157.591080:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1087 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.591086:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1087 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.591137:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1079 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105db6 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.591219:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd108e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105db6 expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.591228:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99eefe73f600) 00010000:00010000:3.0:1788330157.591230:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788330157.591232:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cb200, rc 0) 00000100:00100000:3.0:1788330157.591326:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:10515:x1875199766060672:12345-192.168.202.50@tcp:101:touch.500 Request processed in 82340us (83235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330157.591337:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 29 00000100:00100000:3.0:1788330157.617756:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330157.620703:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766060928 00000100:00100000:2.0:1788330157.620728:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766060928 00000100:00100000:3.0:1788330157.621009:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:3.0:1788330157.621024:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:10515:x1875199766060928:12345-192.168.202.50@tcp:101:touch.500 00010000:00010000:3.0:1788330157.621055:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330157.621086:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1095 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105dbd expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.623172:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd109c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.623205:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd109c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.623221:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd109c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.623240:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd10a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xf07993be bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.623278:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd10a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.623286:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd10a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788330157.623775:0:12916:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788330157.623961:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd10aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.623972:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd10aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.623980:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd10aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.624024:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd109c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.624033:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd109c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.624041:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd109c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.624048:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59ca200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330157.624053:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd109c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.624063:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd109c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.624093:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99eefe73f600) 00010000:00010000:3.0:1788330157.624097:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330157.624103:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd109c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.624110:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd109c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330157.624127:0:12916:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c9096ff6 reply state 00000000c5b267ae transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd10a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.624140:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd10a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.624147:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf07993be (ffff99eefe73ff00) 00010000:00010000:3.0:1788330157.624199:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788330157.624203:0:12916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788330157.624246:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1095 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105dbd expref: 10 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.624263:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd10aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105dbd expref: 9 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.624271:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff99eefe73f500) 00010000:00010000:3.0:1788330157.624273:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788330157.624275:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cb600, rc 0) 00000100:00100000:3.0:1788330157.624373:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+10:10515:x1875199766060928:12345-192.168.202.50@tcp:101:touch.500 Request processed in 3351us (6633us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788330157.624383:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:0.0:1788330157.633463:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330157.633737:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766061184 00000100:00100000:3.0:1788330157.633750:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766061184 00000100:00100000:3.0:1788330157.633827:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:3.0:1788330157.633840:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+10:10515:x1875199766061184:12345-192.168.202.50@tcp:36:touch.500 00010000:00010000:3.0:1788330157.633921:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330157.633956:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd10aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105dbd expref: 10 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.633977:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff99eefe73f500) 00010000:00010000:3.0:1788330157.633991:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330157.634060:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd10b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.634078:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd10b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.634090:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd10b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330157.634295:0:6522:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004e65fc7d reply state 00000000c14c5699 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd10b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.634309:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd10b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.634316:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff99eefe73f900) 00010000:00010000:3.0:1788330157.634319:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788330157.634322:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788330157.634438:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+11:10515:x1875199766061184:12345-192.168.202.50@tcp:36:touch.500 Request processed in 599us (992us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788330157.634446:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:0.0:1788330157.637781:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330157.637991:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766061312 00000100:00100000:3.0:1788330157.638004:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766061312 00000100:00100000:3.0:1788330157.638084:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:3.0:1788330157.638096:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+11:10515:x1875199766061312:12345-192.168.202.50@tcp:101:touch.500 00010000:00010000:3.0:1788330157.638128:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330157.638381:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd10bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105dc4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.638459:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd10bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105dc4 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.638477:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd10bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105dc4 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.638509:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff99eefe73f900) 00010000:00010000:3.0:1788330157.638513:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788330157.638518:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59caa00, rc 0) 00000100:00100000:3.0:1788330157.638601:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+12:10515:x1875199766061312:12345-192.168.202.50@tcp:101:touch.500 Request processed in 507us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330157.638608:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:0.0:1788330157.641672:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330157.641855:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766061440 00000100:00100000:1.0:1788330157.641869:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766061440 00000100:00100000:1.0:1788330157.641927:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:1.0:1788330157.641939:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2409:x1875199766061440:12345-192.168.202.50@tcp:8:touch.500 00010000:00080000:1.0:1788330157.641986:0:8439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp t0 exp 0000000000000000 cur 361 last 0 00000020:00000080:1.0:1788330157.642025:0:8439:0:(genops.c:1385:class_connect()) connect: client f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3, cookie 0x8475908e9fd10c6 00002000:00100000:1.0:1788330157.642041:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3/ffff99eef6dce800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788330157.642064:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788330157.642409:0:8439:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788330157.642449:0:8439:0:(import.c:65:import_set_state_nolock()) ffff99eef6dc9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788330157.642598:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2409:x1875199766061440:12345-192.168.202.50@tcp:8:touch.500 Request processed in 658us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330157.642607:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:0.0:1788330157.650022:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330157.650133:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766061568 00000100:00100000:2.0:1788330157.650146:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766061568 00000100:00100000:2.0:1788330157.650303:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:2.0:1788330157.650318:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefea0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:0:x1875199766061568:12345-192.168.202.50@tcp:2:touch.500 00000100:00080000:0.0:1788330157.657119:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788330157.668251:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:3.0:1788330157.668270:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00000100:00100000:2.0:1788330157.668560:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefea0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:0:x1875199766061568:12345-192.168.202.50@tcp:2:touch.500 Request processed in 18240us (18549us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788330157.668573:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:2.0:1788330157.676351:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330157.677816:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766061824 00000100:00100000:3.0:1788330157.677829:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766061824 00000100:00100000:3.0:1788330157.677911:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:3.0:1788330157.677928:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+12:10515:x1875199766061824:12345-192.168.202.50@tcp:35:touch.500 00000100:00100000:3.0:1788330157.678290:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+13:10515:x1875199766061824:12345-192.168.202.50@tcp:35:touch.500 Request processed in 369us (1949us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788330157.678317:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:0.0:1788330157.708769:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330157.710146:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766061952 00000100:00100000:2.0:1788330157.710202:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766061952 00000100:00100000:2.0:1788330157.710277:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:2.0:1788330157.710289:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+13:10516:x1875199766061952:12345-192.168.202.50@tcp:101:rm.0 00010000:00010000:2.0:1788330157.710312:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330157.710335:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd10cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105dcb expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.710424:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b600/0x8475908e9fd10d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.710438:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b600/0x8475908e9fd10d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.710449:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b600/0x8475908e9fd10d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330157.710494:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788330157.710498:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330157.710535:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b600/0x8475908e9fd10d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.710589:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd10cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105dcb expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.710608:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b600/0x8475908e9fd10d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105dcb expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.710616:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99eefe73f600) 00010000:00010000:2.0:1788330157.710619:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330157.710623:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99edc765b600, rc 0) 00000100:00100000:2.0:1788330157.710701:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:10516:x1875199766061952:12345-192.168.202.50@tcp:101:rm.0 Request processed in 415us (1941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330157.710708:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:1.0:1788330157.719466:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330157.726549:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766062208 00000100:00100000:2.0:1788330157.726566:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766062208 00000100:00100000:2.0:1788330157.726646:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:2.0:1788330157.726658:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:10516:x1875199766062208:12345-192.168.202.50@tcp:101:rm.0 00010000:00010000:2.0:1788330157.726700:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330157.726730:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd10db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105dd2 expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330157.726838:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788330157.726996:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd10db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105dd2 expref: 16 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.727012:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eefe73fe00) 00010000:00010000:2.0:1788330157.727015:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788330157.727029:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd10db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105dd2 expref: 16 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.727045:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99edc765a000, rc 0) 00000100:00100000:2.0:1788330157.727129:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:10516:x1875199766062208:12345-192.168.202.50@tcp:101:rm.0 Request processed in 472us (7676us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788330157.727144:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:0.0:1788330157.732211:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330157.732293:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766062336 00000100:00100000:3.0:1788330157.732302:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766062336 00000100:00100000:3.0:1788330157.732355:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:3.0:1788330157.732363:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:10516:x1875199766062336:12345-192.168.202.50@tcp:37:rm.0 00000100:00100000:2.0:1788330157.741976:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:10516:x1875199766062336:12345-192.168.202.50@tcp:37:rm.0 Request processed in 9600us (9765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330157.742107:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:1.0:1788330157.752067:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330157.753531:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766062592 00000100:00100000:0.0:1788330157.753545:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766062592 00000100:00100000:0.0:1788330157.753620:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:0.0:1788330157.753631:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9247050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:10516:x1875199766062592:12345-192.168.202.50@tcp:35:rm.0 00000100:00100000:0.0:1788330157.753931:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9247050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+16:10516:x1875199766062592:12345-192.168.202.50@tcp:35:rm.0 Request processed in 300us (1875us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788330157.753940:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:0.0:1788330157.763831:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330157.764981:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766062848 00000100:00100000:3.0:1788330157.765001:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766062848 00000100:00100000:3.0:1788330157.765098:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 35 00000100:00100000:3.0:1788330157.765111:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+16:10516:x1875199766062848:12345-192.168.202.50@tcp:101:rm.0 00010000:00010000:3.0:1788330157.765147:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330157.765191:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd10e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105dd9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.765352:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd10f0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.765374:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd10f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330157.765389:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd10f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330157.765404:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788330157.768952:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd10e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105dd9 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.769012:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd10f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105dd9 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.769022:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99eefe73f600) 00010000:00010000:0.0:1788330157.769026:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788330157.769030:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cb400, rc 0) 00000100:00100000:0.0:1788330157.769129:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:10516:x1875199766062848:12345-192.168.202.50@tcp:101:rm.0 Request processed in 4018us (5310us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788330157.769140:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 35 00000100:00100000:3.0:1788330157.772318:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330157.772610:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766062976 00000100:00100000:0.0:1788330157.772625:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766062976 00000100:00100000:0.0:1788330157.772710:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00100000:0.0:1788330157.772733:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:10516:x1875199766062976:12345-192.168.202.50@tcp:41:rm.0 00000004:00000024:0.0:1788330157.772824:0:6522:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1788330157.772927:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:10516:x1875199766062976:12345-192.168.202.50@tcp:41:rm.0 Request processed in 197us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330157.772935:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00100000:1.0:1788330157.784798:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330157.785098:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766063104 00000100:00100000:0.0:1788330157.785114:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766063104 00000100:00100000:0.0:1788330157.785241:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 37 00000100:00100000:0.0:1788330157.785257:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:10516:x1875199766063104:12345-192.168.202.50@tcp:101:rm.0 00010000:00010000:0.0:1788330157.785289:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330157.785325:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2600/0x8475908e9fd10fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105de0 expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.785440:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd1105 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.785461:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd1105 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.785476:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd1105 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.785506:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd110c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf07993be bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.785515:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd110c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.785523:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd110c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.785920:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1113 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.785931:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1113 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.785939:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1113 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330157.785985:0:12916:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788330157.785991:0:12916:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788330157.786014:0:12916:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1113 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.786042:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1113 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.786051:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd1105 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.786058:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd1105 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.786065:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd1105 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.786070:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c3400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330157.786075:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd1105 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.786083:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd1105 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.786100:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99eefe73f600) 00010000:00010000:0.0:1788330157.786104:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330157.786110:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd1105 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.786116:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c3400/0x8475908e9fd1105 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.786133:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd110c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.786139:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd110c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.786196:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd110c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.786202:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330157.786205:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd110c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.786212:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd110c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.786221:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf07993be (ffff99eefe73ff00) 00010000:00010000:0.0:1788330157.786224:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330157.786227:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd110c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.786232:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd110c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.786266:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef58c2600/0x8475908e9fd10fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105de0 expref: 20 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.786283:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1113 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105de0 expref: 19 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330157.786291:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff99eefe73f900) 00010000:00010000:0.0:1788330157.786293:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330157.786296:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327800, rc 0) 00000100:00100000:0.0:1788330157.786648:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:10516:x1875199766063104:12345-192.168.202.50@tcp:101:rm.0 Request processed in 1391us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330157.786668:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 37 00000100:00100000:3.0:1788330157.796522:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330157.796831:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766063360 00000100:00100000:2.0:1788330157.796855:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766063360 00000100:00100000:0.0:1788330157.799074:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 38 00000100:00100000:0.0:1788330157.799108:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:10516:x1875199766063360:12345-192.168.202.50@tcp:36:rm.0 00010000:00010000:1.0:1788330157.808592:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788330157.808653:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1113 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105de0 expref: 19 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.808716:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd10bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105dc4 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.808740:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff99eefe73f900) 00010000:00010000:1.0:1788330157.808782:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b600/0x8475908e9fd10d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105dcb expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.808792:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99eefe73f600) 00010000:00010000:1.0:1788330157.808796:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788330157.808825:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78e00/0x8475908e9fd111a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.808840:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78e00/0x8475908e9fd111a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.809023:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78e00/0x8475908e9fd111a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.809041:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1121 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xf07993be bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.809050:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1121 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.809057:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1121 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.809224:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1128 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.809234:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1128 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.809242:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1128 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788330157.810319:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788330157.810352:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361782200432ns, next at 362782197095ns, rc = 0 00010000:00010000:1.0:1788330157.810429:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78c00/0x8475908e9fd112f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810444:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78c00/0x8475908e9fd112f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810455:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78c00/0x8475908e9fd112f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810463:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78c00/0x8475908e9fd112f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810470:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78c00/0x8475908e9fd112f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810476:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78c00/0x8475908e9fd112f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810497:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788330157.810528:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1128 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810534:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1128 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810541:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1128 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810547:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330157.810552:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1128 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810569:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1128 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810583:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff99eefe73f900) 00010000:00010000:1.0:1788330157.810586:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788330157.810591:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1128 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810597:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1128 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810617:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78e00/0x8475908e9fd111a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810622:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78e00/0x8475908e9fd111a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810627:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78e00/0x8475908e9fd111a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810631:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330157.810634:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78e00/0x8475908e9fd111a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810639:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78e00/0x8475908e9fd111a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810645:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99eefe73f600) 00010000:00010000:1.0:1788330157.810647:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330157.810651:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78e00/0x8475908e9fd111a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810666:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78e00/0x8475908e9fd111a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788330157.810678:0:6523:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cbd2db1a reply state 000000008a0b83f4 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1121 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810703:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1121 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330157.810710:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf07993be (ffff99eefe73ff00) 00010000:00010000:1.0:1788330157.810713:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330157.810893:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330157.810903:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78c00/0x8475908e9fd112f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.810909:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78c00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330157.810913:0:10341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78c00/0x8475908e9fd112f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.810919:0:10341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78c00/0x8475908e9fd112f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.810928:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff99eefe73f900) 00010000:00010000:2.0:1788330157.810930:0:10341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788330157.810933:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78c00/0x8475908e9fd112f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.810938:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78c00/0x8475908e9fd112f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.810961:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330157.810962:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330157.810965:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330157.811555:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788330157.811756:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:10516:x1875199766063360:12345-192.168.202.50@tcp:36:rm.0 Request processed in 12657us (15244us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788330157.811778:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 38 00000100:00100000:1.0:1788330157.824270:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330157.824422:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766063616 00000100:00100000:0.0:1788330157.824437:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766063616 00000100:00100000:0.0:1788330157.824507:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:0.0:1788330157.824520:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:10516:x1875199766063616:12345-192.168.202.50@tcp:35:rm.0 00000100:00100000:0.0:1788330157.825024:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:10516:x1875199766063616:12345-192.168.202.50@tcp:35:rm.0 Request processed in 503us (770us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788330157.825035:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:1.0:1788330157.827886:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330157.828036:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766063872 00000100:00100000:2.0:1788330157.828049:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766063872 00000100:00100000:2.0:1788330157.828131:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00100000:2.0:1788330157.828144:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:10516:x1875199766063872:12345-192.168.202.50@tcp:36:rm.0 00010000:00010000:2.0:1788330157.828261:0:7832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788330157.828298:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd10f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105dd9 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.828322:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd108e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105db6 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.828335:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99eefe73f600) 00010000:00010000:2.0:1788330157.828357:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a400/0x8475908e9fd104f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105da8 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.828366:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eefe73fe00) 00010000:00010000:2.0:1788330157.828373:0:7832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330157.828405:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1136 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.828420:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1136 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.828431:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1136 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.828462:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a800/0x8475908e9fd113d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.828469:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a800/0x8475908e9fd113d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.828475:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a800/0x8475908e9fd113d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.828584:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765bc00/0x8475908e9fd1144 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.828593:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765bc00/0x8475908e9fd1144 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.828599:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765bc00/0x8475908e9fd1144 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330157.828922:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788330157.828940:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765bc00/0x8475908e9fd1144 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.828948:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765bc00/0x8475908e9fd1144 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.828954:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765bc00/0x8475908e9fd1144 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.828960:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765bc00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330157.828965:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765bc00/0x8475908e9fd1144 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.828983:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765bc00/0x8475908e9fd1144 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.828993:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff99edc10b4900) 00010000:00010000:2.0:1788330157.828997:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788330157.829001:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765bc00/0x8475908e9fd1144 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.829006:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765bc00/0x8475908e9fd1144 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.829028:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1136 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.829033:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1136 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.829038:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1136 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.829043:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765a000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330157.829045:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1136 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.829051:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1136 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.829057:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99edc10b4100) 00010000:00010000:2.0:1788330157.829059:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330157.829062:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1136 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.829076:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1136 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330157.829089:0:7832:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e24574bb reply state 00000000efa9497e transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a800/0x8475908e9fd113d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.829101:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a800/0x8475908e9fd113d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330157.829107:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99edc10b4a00) 00010000:00010000:2.0:1788330157.829109:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788330157.829112:0:7832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330157.829245:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:10516:x1875199766063872:12345-192.168.202.50@tcp:36:rm.0 Request processed in 1102us (1372us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788330157.829255:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 39 00010000:00010000:0.0:1788330157.979462:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330158.492950:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330158.492980:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792363648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330158.493080:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330158.493182:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792363648 00000100:00100000:0.0:1788330158.493205:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792363648 00000100:00100000:0.0:1788330158.493266:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788330158.493280:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792363648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330158.493336:0:7831:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788330158.493751:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792363520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330158.493798:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330158.493845:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792363776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788330158.493873:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330158.493904:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792363520 00000100:00100000:1.0:1788330158.493910:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792363520 00000100:00100000:1.0:1788330158.493956:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792363776 00000100:00100000:1.0:1788330158.493959:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792363776 00000100:00100000:1.0:1788330158.493980:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788330158.493987:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792363520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330158.494007:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330158.494073:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792363520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330158.494082:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788330158.494101:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788330158.494107:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792363776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788330158.494117:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330158.494142:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792363776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330158.494175:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1788330158.494195:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788330158.494235:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7696a00 x1875199792363520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330158.494259:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792363520:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788330158.494290:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec12e8000 x1875199792363776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330158.494300:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792363776:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330158.495300:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792363648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2012us (2210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330158.495312:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788330158.499275:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792363648:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788330159.006024:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330160.027440:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1788330160.027552:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330160.035977:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792363904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330160.036107:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330160.036259:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792363904 00000100:00100000:3.0:1788330160.036269:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792363904 00000100:00100000:3.0:1788330160.036343:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788330160.036356:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792363904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330160.036399:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330160.036456:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792363904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330160.036464:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1788330160.036489:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788330160.036530:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec12af480 x1875199792363904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330160.036554:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792363904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330160.037131:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330160.037170:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792364032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788330160.037219:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330160.037274:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792364032 00000100:00100000:0.0:1788330160.037279:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792364032 00000100:00100000:0.0:1788330160.037322:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788330160.037331:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792364032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788330160.037348:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330160.037386:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792364032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330160.037393:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:0.0:1788330160.037428:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7695180 x1875199792364032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330160.037444:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792364032:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788330160.042349:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788330161.051632:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330161.052142:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792364160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330161.052262:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330161.052500:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792364160 00000100:00100000:3.0:1788330161.052510:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792364160 00000100:00100000:3.0:1788330161.052586:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788330161.052607:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792364160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788330161.052667:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788330161.052747:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792364160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330161.052755:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788330161.052814:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792364160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330161.565387:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792364288:0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.565501:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330161.565565:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792364800:0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.565597:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330161.565619:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792365312:0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.565642:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330161.565683:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788330161.565689:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792364672:0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.565720:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330161.565739:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792365184:0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.565787:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330161.565805:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792365696:0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.565833:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330161.565870:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792364416:0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.565925:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330161.565945:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792364928:0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.565966:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330161.565985:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792365440:0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.566006:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330161.566026:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788330161.566031:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792364544:0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.566054:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330161.566064:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792365056:0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.566084:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330161.566100:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792365568:0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.566119:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330161.566183:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792364288 00000100:00100000:0.0:1788330161.566193:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792364288 00000100:00100000:0.0:1788330161.566249:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788330161.566260:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3649:x1875199792364288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.566321:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3649:x1875199792364288:12345-0@lo:400:kworker.0 Request processed in 62us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330161.566329:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788330161.566370:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792364800 00000100:00100000:0.0:1788330161.566374:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792364800 00000100:00100000:0.0:1788330161.566410:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792365312 00000100:00100000:0.0:1788330161.566414:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792365312 00000100:00100000:0.0:1788330161.566426:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792364416 00000100:00100000:0.0:1788330161.566429:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792364416 00000100:00100000:0.0:1788330161.566440:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792364928 00000100:00100000:0.0:1788330161.566442:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792364928 00000100:00100000:0.0:1788330161.566468:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792365440 00000100:00100000:0.0:1788330161.566471:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792365440 00000100:00100000:0.0:1788330161.566484:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792364544 00000100:00100000:0.0:1788330161.566486:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792364544 00000100:00100000:0.0:1788330161.566500:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788330161.566507:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792364800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.566541:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792364800:12345-0@lo:400:kworker.0 Request processed in 35us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330161.566548:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788330161.566560:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788330161.566567:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792365312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.566594:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792365312:12345-0@lo:400:kworker.0 Request processed in 28us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330161.566601:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788330161.566612:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788330161.566618:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792364416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.566659:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792364416:12345-0@lo:400:kworker.0 Request processed in 30us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330161.566665:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788330161.566678:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788330161.566683:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792364928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.566712:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792364928:12345-0@lo:400:kworker.0 Request processed in 30us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330161.566718:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788330161.566728:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788330161.566734:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792365440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.566771:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792365440:12345-0@lo:400:kworker.0 Request processed in 36us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330161.566777:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788330161.566789:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788330161.566795:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792364544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.566824:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792364544:12345-0@lo:400:kworker.0 Request processed in 30us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330161.566829:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788330161.566857:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792364672 00000100:00100000:0.0:1788330161.566860:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792364672 00000100:00100000:0.0:1788330161.566889:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788330161.566896:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792364672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.566931:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792364672:12345-0@lo:400:kworker.0 Request processed in 37us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330161.566938:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788330161.566959:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792365184 00000100:00100000:0.0:1788330161.566963:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792365184 00000100:00100000:0.0:1788330161.566991:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792365696 00000100:00100000:0.0:1788330161.566994:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792365696 00000100:00100000:0.0:1788330161.567007:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792365056 00000100:00100000:0.0:1788330161.567010:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792365056 00000100:00100000:0.0:1788330161.567019:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792365568 00000100:00100000:0.0:1788330161.567021:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792365568 00000100:00100000:0.0:1788330161.567037:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788330161.567044:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792365184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.567076:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792365184:12345-0@lo:400:kworker.0 Request processed in 33us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330161.567093:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788330161.567105:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788330161.567111:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792365696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.567145:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792365696:12345-0@lo:400:kworker.0 Request processed in 34us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330161.567173:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788330161.567185:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788330161.567191:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792365056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.567219:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792365056:12345-0@lo:400:kworker.0 Request processed in 28us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330161.567225:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788330161.567236:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788330161.567243:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792365568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.567268:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792365568:12345-0@lo:400:kworker.0 Request processed in 27us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330161.567274:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1788330161.567325:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330161.567331:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788330161.567334:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330161.567378:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792364544:0@lo:400:kworker.0 00010000:00080000:0.0:1788330161.567394:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcf8380 x1875199792365056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330161.567406:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792365056:0@lo:400:kworker.0 00010000:00080000:0.0:1788330161.567417:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6ea0e00 x1875199792365568/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330161.567433:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792365568:0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.567448:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792364416:0@lo:400:kworker.0 00010000:00080000:0.0:1788330161.567458:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcfb100 x1875199792364928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330161.567466:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792364928:0@lo:400:kworker.0 00010000:00080000:0.0:1788330161.567479:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eee7640000 x1875199792365440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330161.567487:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792365440:0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.567533:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792364672:0@lo:400:kworker.0 00010000:00080000:0.0:1788330161.567544:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fd180 x1875199792365184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330161.567553:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792365184:0@lo:400:kworker.0 00010000:00080000:0.0:1788330161.567562:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6ea1500 x1875199792365696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330161.567569:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792365696:0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.567578:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792364288:0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.567588:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792364800:0@lo:400:kworker.0 00000100:00100000:0.0:1788330161.567598:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792365312:0@lo:400:kworker.0 00000100:00100000:3.0:1788330161.890447:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330161.890518:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330161.890555:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330161.890602:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330161.890655:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330161.890685:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330161.890810:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766064256 00000100:00100000:1.0:1788330161.890827:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766064256 00000100:00100000:1.0:1788330161.890922:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766064512 00000100:00100000:1.0:1788330161.890926:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766064512 00000100:00100000:1.0:1788330161.890955:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766064128 00000100:00100000:1.0:1788330161.890958:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766064128 00000100:00100000:1.0:1788330161.890972:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766064640 00000100:00100000:1.0:1788330161.890974:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766064640 00000100:00100000:1.0:1788330161.890995:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 237 00000100:00100000:1.0:1788330161.891008:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766064256:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330161.891138:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766064256:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 132us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330161.891147:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 237 00000100:00100000:1.0:1788330161.891201:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 238 00000100:00100000:1.0:1788330161.891208:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766064512:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330161.891235:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766064512:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 29us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330161.891241:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 238 00000100:00100000:1.0:1788330161.891253:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 239 00000100:00100000:1.0:1788330161.891259:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:2411:x1875199766064128:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330161.891287:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:2411:x1875199766064128:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 29us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330161.891292:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 239 00000100:00100000:1.0:1788330161.891304:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 240 00000100:00100000:1.0:1788330161.891309:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766064640:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330161.891330:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766064640:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 21us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330161.891335:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 240 00000100:00080000:3.0:1788330161.892337:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788330161.892346:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788330161.892433:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766064000 00000100:00100000:0.0:1788330161.892458:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766064000 00000100:00100000:0.0:1788330161.892536:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 343 00000100:00100000:0.0:1788330161.892547:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2411:x1875199766064000:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330161.892626:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2411:x1875199766064000:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 81us (2196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330161.892634:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 343 00000100:00100000:0.0:1788330161.892697:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766064384 00000100:00100000:0.0:1788330161.892702:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766064384 00000100:00100000:0.0:1788330161.892756:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 96 00000100:00100000:0.0:1788330161.892763:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766064384:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330161.892793:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766064384:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 30us (2148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330161.892799:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 96 00000100:00080000:2.0:1788330161.892885:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788330162.082449:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330163.104887:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788330163.115007:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1788330163.115038:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1788330163.115139:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd10a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115187:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd10a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115198:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd10a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115203:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59ca600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330163.115209:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd10a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115218:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd10a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115244:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf07993be (ffff99eefe73ff00) 00010000:00010000:1.0:1788330163.115248:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330163.115253:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd10a3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115271:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd10a3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115296:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd10b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115303:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd10b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115308:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd10b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115335:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59ca200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330163.115338:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd10b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115345:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd10b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115355:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff99eefe73f900) 00010000:00010000:1.0:1788330163.115358:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330163.115363:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd10b8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115368:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd10b8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115391:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1121 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115397:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1121 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115402:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1121 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115407:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330163.115410:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1121 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115415:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1121 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115434:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf07993be (ffff99eefe73ff00) 00010000:00010000:1.0:1788330163.115436:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330163.115439:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1121 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115444:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1121 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf07993be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115460:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a800/0x8475908e9fd113d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115466:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a800/0x8475908e9fd113d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115471:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a800/0x8475908e9fd113d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115476:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765a800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330163.115479:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a800/0x8475908e9fd113d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115484:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a800/0x8475908e9fd113d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115490:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99edc10b4a00) 00010000:00010000:1.0:1788330163.115492:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330163.115494:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a800/0x8475908e9fd113d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.115500:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a800/0x8475908e9fd113d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330163.116358:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788330163.116386:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792365824:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788330163.116479:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330163.116556:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792365824 00000100:00100000:1.0:1788330163.116564:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792365824 00000100:00100000:1.0:1788330163.116654:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788330163.116666:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792365824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788330163.116712:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1788330163.116755:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a97c0ad, atime: 0x6a97c0ad, ctime: 0x6a97c0ad, blocks: 0x0 00010000:00010000:1.0:1788330163.116765:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f1406ad/0x8475908e9fd114b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.116785:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=367s v=(0 0) 00010000:00010000:1.0:1788330163.116791:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330163.116800:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f1406ad/0x8475908e9fd114b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.116819:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f1406ad/0x8475908e9fd114b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.116828:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f1406ad/0x8475908e9fd114b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.116836:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f1406ad/0x8475908e9fd114b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.116878:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788330163.117087:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875199792365824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 423us (607us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788330163.117096:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788330163.117131:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788330163.117179:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330163.117188:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f1406ad/0x8475908e9fd114b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.117197:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78c00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330163.117202:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f1406ad/0x8475908e9fd114b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.117211:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f1406ad/0x8475908e9fd114b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.117230:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f1406ad/0x8475908e9fd114b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.117237:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f1406ad/0x8475908e9fd114b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330163.117257:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330163.117259:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330163.117261:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788330163.117299:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99eec12eaa00/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788330163.117312:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792365824:0@lo:6:osp-syn-1-0.0 00000001:02000400:3.0:1788330163.603563:0:13691:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1788330163.613467:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792365952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330163.613578:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330163.613682:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330163.613691:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792366080:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330163.613726:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330163.613785:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792365952 00000100:00100000:3.0:1788330163.613795:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792365952 00000100:00100000:3.0:1788330163.613858:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788330163.613869:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792365952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330163.613914:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330163.613984:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792365952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330163.613991:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788330163.614057:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792365952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330163.614809:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788330163.614830:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792366208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330163.614882:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330163.615431:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792366080 00000100:00100000:1.0:1788330163.615441:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792366080 00000100:00100000:1.0:1788330163.615493:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788330163.615503:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792366080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788330163.615546:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788330163.615608:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792366080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (1878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330163.615615:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788330163.615689:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792366080:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330163.616368:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792366208 00000100:00100000:3.0:1788330163.616377:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792366208 00000100:00100000:3.0:1788330163.616532:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788330163.616541:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792366208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788330163.616559:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330163.616619:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792366208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330163.616625:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788330163.616716:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792366208:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788330163.617086:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788330164.123752:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788330165.108578:0:13739:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd07f22460 20000000:00000080:2.0:1788330165.108602:0:13739:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99edc7c3bc00 uarg=0000000000000000 20000000:01000000:2.0:1788330165.108745:0:13739:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788330165.108755:0:13739:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788330165.108761:0:13739:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788330165.112625:0:13740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788330165.112957:0:13739:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788330165.123989:0:13739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788330165.124031:0:13739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788330165.124049:0:13739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788330165.124068:0:13739:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788330165.124099:0:13739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99eec1326800/0x8475908e9fd1152 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.124128:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef59cba00/0x8475908e9fd0fd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d93 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.124137:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef6e79400/0x8475908e9fd0fdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d9a expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.124145:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef58c2c00/0x8475908e9fd0fed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0fe6 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.124196:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef59ca000/0x8475908e9fd0ffb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd0ff4 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.124204:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99edc765ba00/0x8475908e9fd1009 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd1002 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.124211:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef58c3a00/0x8475908e9fd1017 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd1010 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.124219:0:13739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99eec1326800/0x8475908e9fd1152 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.124287:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef58c3a00/0x8475908e9fd1017 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd1010 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.124302:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eef58c3a00/0x8475908e9fd1017 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd1010 expref: 23 pid: 6517 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330165.124319:0:13739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7695180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875199792366336:0@lo:104: 00000100:00100000:0.0:1788330165.124424:0:13739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330165.124500:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99edc765ba00/0x8475908e9fd1009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd1002 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.124508:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99edc765ba00/0x8475908e9fd1009 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd1002 expref: 23 pid: 6516 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330165.124517:0:13739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875199792366464:0@lo:104: 00010000:00010000:0.0:1788330165.124544:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef59ca000/0x8475908e9fd0ffb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0ff4 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.124563:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eef59ca000/0x8475908e9fd0ffb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0ff4 expref: 23 pid: 6515 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330165.124572:0:13739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875199792366592:0@lo:104: 00010000:00010000:0.0:1788330165.124602:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef58c2c00/0x8475908e9fd0fed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd0fe6 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.124609:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99eef58c2c00/0x8475908e9fd0fed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd0fe6 expref: 23 pid: 6515 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330165.124631:0:13739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875199792366720:0@lo:104: 00000100:00100000:3.0:1788330165.125062:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788330165.125089:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330165.125566:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330165.125670:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef6e79400/0x8475908e9fd0fdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d9a expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.125686:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eef6e79400/0x8475908e9fd0fdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d9a expref: 12 pid: 6517 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330165.125700:0:13739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875199792366848:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330165.125789:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef59cba00/0x8475908e9fd0fd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d93 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.125799:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eef59cba00/0x8475908e9fd0fd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d93 expref: 12 pid: 6517 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330165.125808:0:13739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875199792366976:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330165.125836:0:13739:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7263300 going to sleep for 11 seconds 00000100:00100000:3.0:1788330165.126801:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330165.126873:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792366336 00000100:00100000:2.0:1788330165.126883:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792366336 00000100:00100000:2.0:1788330165.126945:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792366464 00000100:00100000:2.0:1788330165.126948:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792366464 00000100:00100000:2.0:1788330165.126959:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792366592 00000100:00100000:2.0:1788330165.126962:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792366592 00000100:00100000:2.0:1788330165.126977:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788330165.126989:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc1720050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+5:13739:x1875199792366336:12345-0@lo:104: 00010000:00010000:2.0:1788330165.127007:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd1010 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd1017 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330165.127099:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788330165.127106:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc1720050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+5:13739:x1875199792366336:12345-0@lo:104: Request processed in 120us (2682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330165.127114:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788330165.127190:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788330165.127207:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6606d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:13739:x1875199792366464:12345-0@lo:104: 00010000:00010000:2.0:1788330165.127216:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd1002 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd1009 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330165.127265:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788330165.127271:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6606d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+4:13739:x1875199792366464:12345-0@lo:104: Request processed in 75us (2182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330165.127277:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788330165.127291:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788330165.127298:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6607b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:13739:x1875199792366592:12345-0@lo:104: 00010000:00010000:2.0:1788330165.127307:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99edc765a600/0x8475908e9fd0ff4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0ffb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330165.127363:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788330165.127370:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6607b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:13739:x1875199792366592:12345-0@lo:104: Request processed in 72us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330165.127376:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:2.0:1788330165.127401:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788330165.127408:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd1010 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd1017 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330165.127416:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79c00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:2.0:1788330165.127422:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd1010 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd1017 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330165.127432:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd1010 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd1017 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330165.127440:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd1010 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd1017 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330165.127447:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788330165.127497:0:10341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd1010 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd1017 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330165.127505:0:10341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788330165.127533:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd1010 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd1017 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330165.127541:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef6e79c00/0x8475908e9fd1010 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd1017 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330165.127566:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788330165.127570:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd1002 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd1009 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330165.127577:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c2800 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:2.0:1788330165.127580:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd1002 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd1009 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330165.127587:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd1002 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd1009 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330165.127595:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd1002 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd1009 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330165.127600:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788330165.127630:0:10341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd1002 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd1009 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330165.127637:0:10341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788330165.127857:0:13739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7695180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875199792366336:0@lo:104: 00000100:00100000:1.0:1788330165.127869:0:13739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875199792366464:0@lo:104: 00000100:00100000:1.0:1788330165.127876:0:13739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875199792366592:0@lo:104: 00000100:00100000:1.0:1788330165.128015:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1788330165.128036:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd1002 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd1009 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330165.128044:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef58c2800/0x8475908e9fd1002 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd1009 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330165.128054:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330165.128057:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99edc765a600/0x8475908e9fd0ff4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0ffb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330165.128074:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765a600 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:2.0:1788330165.128077:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99edc765a600/0x8475908e9fd0ff4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0ffb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330165.128084:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99edc765a600/0x8475908e9fd0ff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0ffb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330165.128090:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99edc765a600/0x8475908e9fd0ff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0ffb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330165.128098:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788330165.128114:0:10341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99edc765a600/0x8475908e9fd0ff4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0ffb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330165.128119:0:10341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788330165.130561:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792366720 00000100:00100000:3.0:1788330165.130580:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792366720 00000100:00100000:3.0:1788330165.130668:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788330165.130682:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6605f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:13739:x1875199792366720:12345-0@lo:104: 00010000:00010000:3.0:1788330165.130706:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0fe6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0fed expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330165.130814:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788330165.130821:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6605f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+3:13739:x1875199792366720:12345-0@lo:104: Request processed in 144us (4026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330165.130829:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788330165.131019:0:13739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875199792366720:0@lo:104: 00000100:00100000:0.0:1788330165.131103:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792367360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330165.131211:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330165.131261:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792367232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330165.131295:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330165.131471:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792367360 00000100:00100000:1.0:1788330165.131477:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792367360 00010000:00010000:1.0:1788330165.131511:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef59ca000/0x8475908e9fd0ffb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0ff4 expref: 24 pid: 6515 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330165.131538:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792367232 00000100:00100000:1.0:1788330165.131541:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792367232 00010000:00010000:1.0:1788330165.131555:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99edc765ba00/0x8475908e9fd1009 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd1002 expref: 25 pid: 6516 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330165.131576:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788330165.131594:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+25:3647:x1875199792367360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330165.131609:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330165.131627:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef59ca000/0x8475908e9fd0ffb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0ff4 expref: 25 pid: 6515 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330165.131641:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef59ca000/0x8475908e9fd0ffb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0ff4 expref: 25 pid: 6515 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330165.131668:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef59ca000/0x8475908e9fd0ffb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0ff4 expref: 25 pid: 6515 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330165.131690:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330165.131731:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792367360:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330165.131738:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788330165.131754:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788330165.131760:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:3647:x1875199792367232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330165.131768:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330165.131773:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99edc765ba00/0x8475908e9fd1009 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd1002 expref: 23 pid: 6516 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330165.131782:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99edc765ba00/0x8475908e9fd1009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd1002 expref: 23 pid: 6516 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330165.131792:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99edc765ba00/0x8475908e9fd1009 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd1002 expref: 23 pid: 6516 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330165.131802:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330165.131825:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:3647:x1875199792367232:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330165.131838:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788330165.132008:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792367360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330165.132018:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792367232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330165.132496:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792367104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330165.132543:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788330165.132599:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330165.132608:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0fe6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd0fed expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330165.132628:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c2e00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330165.132634:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0fe6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd0fed expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330165.132646:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0fe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd0fed expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330165.132662:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0fe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd0fed expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330165.132669:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788330165.132722:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0fe6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0fed expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330165.132731:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330165.132753:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0fe6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0fed expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330165.132761:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef58c2e00/0x8475908e9fd0fe6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0fed expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330165.132778:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330165.132780:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330165.132781:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330165.132789:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330165.132797:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330165.132806:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792367488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330165.132832:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330165.132859:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792367104 00000100:00100000:3.0:1788330165.132865:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792367104 00010000:00010000:3.0:1788330165.132890:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef58c3a00/0x8475908e9fd1017 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd1010 expref: 22 pid: 6517 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330165.132913:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792367488 00000100:00100000:3.0:1788330165.132916:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792367488 00010000:00010000:3.0:1788330165.132928:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef58c2c00/0x8475908e9fd0fed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0fe6 expref: 23 pid: 6515 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330165.132959:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788330165.132966:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6606a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:3649:x1875199792367104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330165.132980:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330165.132985:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef58c3a00/0x8475908e9fd1017 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd1010 expref: 23 pid: 6517 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330165.132997:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef58c3a00/0x8475908e9fd1017 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd1010 expref: 23 pid: 6517 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330165.133011:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c3a00/0x8475908e9fd1017 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd1010 expref: 23 pid: 6517 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330165.133023:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330165.133053:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6606a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:3649:x1875199792367104:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330165.133060:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788330165.133078:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788330165.133083:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6605500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:3649:x1875199792367488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330165.133091:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330165.133096:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef58c2c00/0x8475908e9fd0fed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd0fe6 expref: 21 pid: 6515 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330165.133105:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef58c2c00/0x8475908e9fd0fed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd0fe6 expref: 21 pid: 6515 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330165.133116:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c2c00/0x8475908e9fd0fed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd0fe6 expref: 21 pid: 6515 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330165.133137:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330165.133205:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6605500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:3649:x1875199792367488:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330165.133211:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788330165.133395:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792367488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330165.133409:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792367104:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330165.133805:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99edc765a600/0x8475908e9fd0ff4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0ffb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330165.133815:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99edc765a600/0x8475908e9fd0ff4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd0ffb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330165.133834:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330165.133836:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330165.133839:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330165.136311:0:13739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875199792366976:192.168.202.50@tcp:104: 00000100:00100000:1.0:1788330165.136334:0:13739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875199792366848:192.168.202.50@tcp:104: 00010000:00010000:1.0:1788330165.136393:0:13739:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99eec1326800/0x8475908e9fd1152 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330165.143328:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330165.143400:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766064768 00000100:00100000:3.0:1788330165.143417:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766064768 00000100:00100000:2.0:1788330165.143433:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00010000:00010000:3.0:1788330165.143476:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef59cba00/0x8475908e9fd0fd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d93 expref: 13 pid: 6517 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330165.143543:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766064896 00000100:00100000:3.0:1788330165.143547:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766064896 00010000:00010000:3.0:1788330165.143560:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef6e79400/0x8475908e9fd0fdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d9a expref: 14 pid: 6517 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330165.143591:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 50 00000100:00100000:3.0:1788330165.143604:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa3490c8-da14-415b-81e3-af4ba0c476db+14:2413:x1875199766064768:12345-192.168.202.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788330165.143631:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 51 00010000:00010000:3.0:1788330165.143638:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788330165.143642:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa3490c8-da14-415b-81e3-af4ba0c476db+14:2413:x1875199766064896:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330165.143644:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef59cba00/0x8475908e9fd0fd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d93 expref: 14 pid: 6517 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330165.143651:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330165.143656:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef6e79400/0x8475908e9fd0fdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d9a expref: 14 pid: 6517 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330165.143664:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef59cba00/0x8475908e9fd0fd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d93 expref: 14 pid: 6517 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330165.145460:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef6e79400/0x8475908e9fd0fdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d9a expref: 14 pid: 6517 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330165.145500:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef6e79400/0x8475908e9fd0fdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d9a expref: 14 pid: 6517 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330165.145524:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330165.145727:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2413:x1875199766064896:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 2085us (2289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330165.145741:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:0.0:1788330165.147423:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330165.147456:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792367616:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788330165.147567:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330165.147624:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792367616 00000100:00100000:2.0:1788330165.147635:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792367616 00000100:00080000:0.0:1788330165.147676:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330165.147711:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788330165.147743:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792367616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788330165.147786:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330165.147854:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792367616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330165.147863:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:0.0:1788330165.148143:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcfb100 x1875199792367616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330165.148199:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792367616:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788330165.148328:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330165.151104:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef59cba00/0x8475908e9fd0fd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d93 expref: 12 pid: 6517 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330165.151194:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99eec1326800/0x8475908e9fd1152 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330165.151964:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792367744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330165.152073:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330165.152197:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792367744 00000100:00100000:2.0:1788330165.152210:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792367744 00000100:00100000:2.0:1788330165.152301:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788330165.152314:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792367744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330165.152349:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330165.152415:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792367744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330165.152423:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:2.0:1788330165.152477:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec12ae300 x1875199792367744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330165.152501:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792367744:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788330165.152643:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788330165.153664:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec1326800/0x8475908e9fd1152 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.153914:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eec1326800/0x8475908e9fd1152 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.153922:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eec1326800/0x8475908e9fd1152 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.153927:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99eec1326800/0x8475908e9fd1152 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.153933:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99eec1326800/0x8475908e9fd1152 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.153950:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330165.153955:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99eec1326800/0x8475908e9fd1152 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.153961:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99eec1326800/0x8475908e9fd1152 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.153983:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99eec1326800/0x8475908e9fd1152 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330165.153999:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788330165.154015:0:13739:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99eec1326800/0x8475908e9fd1152 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330165.154022:0:13739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99eec1326800/0x8475908e9fd1152 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330165.154038:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec1326800/0x8475908e9fd1152 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330165.154097:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa3490c8-da14-415b-81e3-af4ba0c476db+11:2413:x1875199766064768:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 10490us (10779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330165.154108:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 50 00010000:00010000:1.0:1788330166.172458:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330166.172713:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330166.172742:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792367872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330166.172845:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330166.173006:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792367872 00000100:00100000:2.0:1788330166.173026:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792367872 00000100:00100000:2.0:1788330166.173096:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788330166.173108:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792367872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788330166.173189:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788330166.173258:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792367872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330166.173267:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788330166.173503:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792367872:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1788330166.316806:0:13790:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeac037f50 20000000:00000080:3.0:1788330166.316831:0:13790:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99edc77df800 uarg=0000000000000000 20000000:01000000:3.0:1788330166.316890:0:13790:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788330166.316898:0:13790:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788330166.316905:0:13790:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1788330166.317737:0:13791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1788330166.317910:0:13790:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1788330166.318023:0:13790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1788330166.318060:0:13790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1788330166.318076:0:13790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1788330166.318091:0:13790:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788330166.318124:0:13790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd1159 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330166.318144:0:13790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd1159 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330166.318191:0:13790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd1159 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330166.318199:0:13790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd1159 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330166.318207:0:13790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd1159 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330166.318214:0:13790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd1159 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330166.318239:0:13790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79c00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330166.318246:0:13790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd1159 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330166.318256:0:13790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd1159 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330166.318275:0:13790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd1159 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330166.318284:0:13790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd1159 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330166.318291:0:13790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef6e79c00/0x8475908e9fd1159 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330166.375011:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330166.375090:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766065024 00000100:00100000:3.0:1788330166.375107:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766065024 00000100:00100000:3.0:1788330166.375217:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 344 00000100:00100000:3.0:1788330166.375232:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+11:6187:x1875199766065024:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330166.375260:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330166.375304:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef59cba00/0x8475908e9fd1160 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105de7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330166.375345:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef59cba00/0x8475908e9fd1160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105de7 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330166.375360:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef59cba00/0x8475908e9fd1160 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105de7 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330166.375372:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cba00, rc 0) 00000100:00100000:3.0:1788330166.375464:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+12:6187:x1875199766065024:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 Request processed in 235us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330166.375491:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 344 00000100:00100000:3.0:1788330166.378814:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330166.379019:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766065152 00000100:00100000:1.0:1788330166.379033:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766065152 00000100:00100000:1.0:1788330166.379102:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 345 00000100:00100000:1.0:1788330166.379115:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+12:6187:x1875199766065152:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330166.379363:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+12:6187:x1875199766065152:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 Request processed in 248us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330166.379373:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 345 00000100:00100000:1.0:1788330166.386739:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330166.386835:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766065280 00000100:00100000:3.0:1788330166.386850:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766065280 00000100:00100000:3.0:1788330166.386924:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 346 00000100:00100000:3.0:1788330166.386939:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+12:6187:x1875199766065280:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330166.387188:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+12:6187:x1875199766065280:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 Request processed in 251us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330166.387198:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 346 00000100:00100000:2.0:1788330166.410833:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330166.411392:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766065408 00000100:00100000:3.0:1788330166.411409:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766065408 00000100:00100000:3.0:1788330166.411530:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 347 00000100:00100000:3.0:1788330166.411544:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+12:10800:x1875199766065408:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788330166.411758:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+12:10800:x1875199766065408:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 215us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330166.411767:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 347 00000100:00100000:3.0:1788330166.432479:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330166.432711:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766065536 00000100:00100000:1.0:1788330166.432725:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766065536 00000100:00100000:1.0:1788330166.432806:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 348 00000100:00100000:1.0:1788330166.432820:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+12:10800:x1875199766065536:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788330166.433061:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+12:10800:x1875199766065536:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 242us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330166.433071:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 348 00000100:00100000:3.0:1788330166.440848:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330166.440892:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766065664 00000100:00100000:3.0:1788330166.440907:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766065664 00000100:00100000:3.0:1788330166.440984:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 349 00000100:00100000:3.0:1788330166.440997:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+12:6187:x1875199766065664:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330166.441021:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330166.441051:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd1167 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105dee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330166.441112:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd1167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105dee expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330166.441126:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd1167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105dee expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330166.441138:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cbc00, rc 0) 00000100:00100000:3.0:1788330166.441302:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:6187:x1875199766065664:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 Request processed in 305us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330166.441312:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 349 00000100:00100000:3.0:1788330166.450445:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330166.450681:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766065792 00000100:00100000:0.0:1788330166.450697:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766065792 00000100:00100000:0.0:1788330166.450782:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 350 00000100:00100000:0.0:1788330166.450796:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:6187:x1875199766065792:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330166.451029:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:6187:x1875199766065792:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 Request processed in 234us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330166.451039:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 350 00000100:00100000:3.0:1788330166.468948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330166.469096:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766065920 00000100:00100000:2.0:1788330166.469110:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766065920 00000100:00100000:2.0:1788330166.469196:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 351 00000100:00100000:2.0:1788330166.469209:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+13:6187:x1875199766065920:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330166.469412:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+13:6187:x1875199766065920:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 Request processed in 203us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330166.469420:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 351 00000100:00100000:0.0:1788330166.503977:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330166.504527:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766066048 00000100:00100000:3.0:1788330166.504544:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766066048 00000100:00100000:3.0:1788330166.504631:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 352 00000100:00100000:3.0:1788330166.504646:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:10804:x1875199766066048:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788330166.504855:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:10804:x1875199766066048:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 211us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330166.504864:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 352 00000100:00100000:2.0:1788330166.512800:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330166.512854:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766066176 00000100:00100000:2.0:1788330166.512868:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766066176 00000100:00100000:2.0:1788330166.512936:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 353 00000100:00100000:2.0:1788330166.512948:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:10804:x1875199766066176:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788330166.513313:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:10804:x1875199766066176:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 365us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330166.513322:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 353 10000000:01000000:1.0:1788330166.619432:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788330166.619458:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eef6de3800 from 7 10000000:01000000:1.0:1788330166.619464:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788330166.619534:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd116e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330166.619548:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd116e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330166.619563:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd116e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330166.619628:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792368000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788330166.619731:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330166.619816:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc72eb240 going to sleep for 11 seconds 00000100:00100000:2.0:1788330166.620367:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792368000 00000100:00100000:2.0:1788330166.620381:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792368000 00000100:00100000:2.0:1788330166.620478:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788330166.620492:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+20:6519:x1875199792368000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330166.620511:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330166.620530:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99edc765a600/0x8475908e9fd1175 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd116e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330166.620563:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99edc765a600/0x8475908e9fd1175 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd116e expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330166.620575:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99edc765a600/0x8475908e9fd1175 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd116e expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330166.620611:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99edc765a600, rc 0) 00000100:00100000:2.0:1788330166.620679:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792368000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330166.620686:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788330166.621027:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792368000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330166.621048:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd116e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1175 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330166.621059:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd116e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd1175 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330166.621460:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792368128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330166.621504:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330166.621541:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc72eb240 going to sleep for 11 seconds 00000100:00100000:2.0:1788330166.621784:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792368128 00000100:00100000:2.0:1788330166.621791:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792368128 00000100:00100000:2.0:1788330166.621846:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788330166.621855:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792368128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330166.624708:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792368128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2834us (3183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330166.624731:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788330166.625234:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792368128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330166.625309:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792368256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330166.625379:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330166.625429:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc72eb240 going to sleep for 11 seconds 00000100:00100000:3.0:1788330166.625520:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792368256 00000100:00100000:3.0:1788330166.625531:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792368256 00000100:00100000:3.0:1788330166.625596:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788330166.625615:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792368256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330166.625765:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792368256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330166.625783:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788330166.626139:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792368256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330166.627682:0:13803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:13803:1875199792368384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330166.627810:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330166.627864:0:13803:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc72eb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788330166.628858:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792368384 00000100:00100000:3.0:1788330166.628870:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792368384 00000100:00100000:3.0:1788330166.628945:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788330166.628957:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:13803:x1875199792368384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330166.629232:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:13803:x1875199792368384:12345-0@lo:502:llog_process_th.0 Request processed in 276us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330166.629240:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788330166.629642:0:13803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:13803:1875199792368384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788330166.629685:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330166.629698:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330166.629701:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788330166.629709:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99eef6de3800 00000020:00000080:1.0:1788330166.629712:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788330166.629791:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330166.629795:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330166.629797:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788330166.629800:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330166.629802:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330166.629804:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788330166.629807:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99eef6de3800 00000020:00000080:1.0:1788330166.629810:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788330166.629859:0:13803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:13803:1875199792368512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330166.629911:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330166.629955:0:13803:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc72eb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788330166.633328:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792368512 00000100:00100000:3.0:1788330166.633352:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792368512 00000100:00100000:3.0:1788330166.633442:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788330166.633457:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:13803:x1875199792368512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330166.633730:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:13803:x1875199792368512:12345-0@lo:502:llog_process_th.0 Request processed in 275us (3816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330166.633740:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788330166.633919:0:13803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:13803:1875199792368512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788330166.633997:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330166.634017:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330166.634020:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788330166.634025:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788330166.635421:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788330166.635481:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788330166.635498:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd116e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1175 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330166.635513:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd116e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1175 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330166.635526:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788330166.635530:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eefe782800 from 7 10000000:01000000:3.0:1788330166.635534:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788330166.635586:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd117c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330166.635770:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd117c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330166.635784:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd117c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330166.635816:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6605c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792368640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788330166.635899:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330166.635957:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70b7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788330166.637333:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792368640 00000100:00100000:1.0:1788330166.637353:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792368640 00000100:00100000:1.0:1788330166.637426:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788330166.637438:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:6519:x1875199792368640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330166.637459:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330166.637483:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd1183 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd117c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330166.637516:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd1183 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd117c expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330166.637528:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd1183 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd117c expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330166.637539:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78e00, rc 0) 00000100:00100000:1.0:1788330166.637637:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792368640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330166.637645:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788330166.637850:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6605c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792368640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330166.637876:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd117c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1183 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330166.637886:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd117c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd1183 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330166.638021:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6605c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792368768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330166.638063:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330166.638105:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70b7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788330166.638849:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792368768 00000100:00100000:1.0:1788330166.638860:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792368768 00000100:00100000:1.0:1788330166.638919:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788330166.638930:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792368768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330166.639145:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792368768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330166.639198:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788330166.639571:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6605c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792368768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330166.639651:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6605c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792368896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330166.639709:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330166.639747:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70b7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788330166.642062:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792368896 00000100:00100000:1.0:1788330166.642084:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792368896 00000100:00100000:2.0:1788330166.642288:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788330166.642305:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792368896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330166.642546:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792368896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 245us (2834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330166.642555:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788330166.642655:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6605c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792368896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330166.642924:0:13805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:13805:1875199792369024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330166.642977:0:13805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330166.643004:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792369024 00000100:00100000:2.0:1788330166.643009:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792369024 00000100:00100000:2.0:1788330166.643037:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788330166.643044:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:13805:x1875199792369024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330166.643133:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:13805:x1875199792369024:12345-0@lo:502:llog_process_th.0 Request processed in 88us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330166.643140:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788330166.645248:0:13805:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc772d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330166.645308:0:13805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:13805:1875199792369024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788330166.645368:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330166.645388:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330166.645391:0:13805:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788330166.645403:0:13805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99eefe782800 00000020:00000080:1.0:1788330166.645407:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788330166.645495:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330166.645499:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330166.645500:0:13805:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788330166.645503:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330166.645505:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330166.645507:0:13805:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788330166.645510:0:13805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99eefe782800 00000020:00000080:1.0:1788330166.645512:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788330166.645569:0:13805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:13805:1875199792369152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330166.645673:0:13805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330166.645727:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792369152 00000100:00100000:1.0:1788330166.645735:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792369152 00000100:00100000:1.0:1788330166.645783:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788330166.645795:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:13805:x1875199792369152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330166.645946:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:13805:x1875199792369152:12345-0@lo:502:llog_process_th.0 Request processed in 151us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330166.645956:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788330166.646002:0:13805:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc72ebc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788330166.646034:0:13805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:13805:1875199792369152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788330166.646054:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330166.646058:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330166.646059:0:13805:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788330166.646063:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788330166.647932:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788330166.647995:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788330166.648020:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd117c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1183 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330166.648036:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd117c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1183 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330166.648049:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788330166.648053:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eef59c6800 from 7 10000000:01000000:2.0:1788330166.648056:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788330166.648104:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765ba00/0x8475908e9fd118a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330166.648116:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99edc765ba00/0x8475908e9fd118a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330166.649443:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99edc765ba00/0x8475908e9fd118a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330166.649497:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792369280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788330166.649611:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330166.649658:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc772d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788330166.649698:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792369280 00000100:00100000:2.0:1788330166.649707:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792369280 00000100:00100000:2.0:1788330166.649769:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788330166.649781:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:6519:x1875199792369280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330166.649819:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330166.649840:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99edc765bc00/0x8475908e9fd1191 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd118a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330166.649874:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99edc765bc00/0x8475908e9fd1191 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd118a expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330166.649887:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99edc765bc00/0x8475908e9fd1191 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd118a expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330166.649897:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99edc765bc00, rc 0) 00000100:00100000:2.0:1788330166.649952:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792369280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330166.649959:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788330166.650031:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792369280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330166.650048:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99edc765ba00/0x8475908e9fd118a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1191 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330166.650058:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99edc765ba00/0x8475908e9fd118a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd1191 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330166.650147:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792369408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330166.650204:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330166.650219:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc772d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788330166.650231:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792369408 00000100:00100000:2.0:1788330166.650234:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792369408 00000100:00100000:2.0:1788330166.650252:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788330166.650258:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792369408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330166.650423:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792369408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330166.650431:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788330166.650460:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792369408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330166.650491:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792369536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330166.650537:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330166.650550:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc772d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788330166.650561:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792369536 00000100:00100000:2.0:1788330166.650564:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792369536 00000100:00100000:2.0:1788330166.650580:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788330166.650586:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792369536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330166.650680:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792369536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330166.650687:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788330166.650725:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792369536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330166.650959:0:13806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:13806:1875199792369664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330166.650996:0:13806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330166.651014:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792369664 00000100:00100000:2.0:1788330166.651017:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792369664 00000100:00100000:2.0:1788330166.651038:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788330166.651045:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:13806:x1875199792369664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330166.651118:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:13806:x1875199792369664:12345-0@lo:502:llog_process_th.0 Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330166.651125:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788330166.651180:0:13806:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76ae480 going to sleep for 11 seconds 00000100:00100000:2.0:1788330166.651193:0:13806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:13806:1875199792369664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788330166.651215:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330166.651227:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330166.651229:0:13806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788330166.651238:0:13806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99eef59c6800 00000020:00000080:2.0:1788330166.651240:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788330166.651300:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330166.651303:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330166.651305:0:13806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788330166.651307:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330166.651310:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330166.651311:0:13806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788330166.651314:0:13806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99eef59c6800 00000020:00000080:2.0:1788330166.651317:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788330166.651347:0:13806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:13806:1875199792369792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330166.651380:0:13806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330166.651399:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792369792 00000100:00100000:2.0:1788330166.651403:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792369792 00000100:00100000:2.0:1788330166.651422:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788330166.651428:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:13806:x1875199792369792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788330166.662247:0:13806:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76ae480 going to sleep for 11 seconds 00000100:00100000:2.0:1788330166.668801:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:13806:x1875199792369792:12345-0@lo:502:llog_process_th.0 Request processed in 17356us (17404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330166.668820:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788330166.669777:0:13806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:13806:1875199792369792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788330166.669825:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330166.669835:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330166.669838:0:13806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788330166.669844:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788330166.671280:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788330166.671322:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788330166.671336:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765ba00/0x8475908e9fd118a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1191 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330166.671370:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99edc765ba00/0x8475908e9fd118a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1191 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330166.671383:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788330166.671386:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eec865b000 from 7 10000000:01000000:2.0:1788330166.671390:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788330166.671437:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765a400/0x8475908e9fd1198 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330166.671462:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99edc765a400/0x8475908e9fd1198 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330166.671474:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99edc765a400/0x8475908e9fd1198 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330166.671503:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792369920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788330166.671588:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330166.671649:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76ae900 going to sleep for 11 seconds 00000100:00100000:2.0:1788330166.671674:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792369920 00000100:00100000:2.0:1788330166.671682:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792369920 00000100:00100000:2.0:1788330166.671737:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788330166.671748:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:6519:x1875199792369920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330166.671763:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330166.671777:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99edc765b400/0x8475908e9fd119f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd1198 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330166.671809:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99edc765b400/0x8475908e9fd119f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd1198 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330166.671833:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99edc765b400/0x8475908e9fd119f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd1198 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330166.671844:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99edc765b400, rc 0) 00000100:00100000:2.0:1788330166.671884:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792369920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330166.671892:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788330166.671943:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792369920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330166.671960:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99edc765a400/0x8475908e9fd1198 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd119f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330166.671971:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99edc765a400/0x8475908e9fd1198 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd119f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330166.672042:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792370048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330166.672069:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330166.672082:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76ae900 going to sleep for 11 seconds 00000100:00100000:2.0:1788330166.672095:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792370048 00000100:00100000:2.0:1788330166.672098:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792370048 00000100:00100000:2.0:1788330166.672124:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788330166.672131:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792370048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330166.672293:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792370048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330166.672301:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788330166.672329:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792370048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330166.672370:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792370176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330166.672413:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330166.672426:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76ae900 going to sleep for 11 seconds 00000100:00100000:2.0:1788330166.672438:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792370176 00000100:00100000:2.0:1788330166.672441:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792370176 00000100:00100000:2.0:1788330166.672457:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788330166.672463:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792370176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330166.672540:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:6519:x1875199792370176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330166.672547:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788330166.672587:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:6519:1875199792370176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330166.672837:0:13807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:13807:1875199792370304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330166.672871:0:13807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330166.672888:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792370304 00000100:00100000:2.0:1788330166.672891:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792370304 00000100:00100000:2.0:1788330166.672911:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788330166.672916:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:13807:x1875199792370304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330166.672984:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:13807:x1875199792370304:12345-0@lo:502:llog_process_th.0 Request processed in 67us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330166.672991:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788330166.673020:0:13807:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76ae0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330166.673032:0:13807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:13807:1875199792370304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788330166.673052:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330166.673063:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330166.673071:0:13807:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788330166.673081:0:13807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99eec865b000 00000020:00000080:2.0:1788330166.673083:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788330166.673143:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330166.673147:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330166.673169:0:13807:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788330166.673173:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330166.673176:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330166.673178:0:13807:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788330166.673181:0:13807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99eec865b000 00000020:00000080:2.0:1788330166.673183:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788330166.673216:0:13807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:13807:1875199792370432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330166.673249:0:13807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330166.673266:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792370432 00000100:00100000:2.0:1788330166.673270:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792370432 00000100:00100000:2.0:1788330166.673289:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788330166.673294:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:13807:x1875199792370432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330166.673353:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:13807:x1875199792370432:12345-0@lo:502:llog_process_th.0 Request processed in 58us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330166.673360:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788330166.673388:0:13807:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc76ae0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330166.673399:0:13807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:13807:1875199792370432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788330166.673416:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330166.673420:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330166.673422:0:13807:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788330166.673426:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788330166.673480:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788330166.673501:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788330166.673509:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765a400/0x8475908e9fd1198 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd119f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330166.673523:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99edc765a400/0x8475908e9fd1198 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd119f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330166.701073:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792370688:0@lo:400:kworker.0 00000100:00100000:3.0:1788330166.701215:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330166.701276:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792371200:0@lo:400:kworker.0 00000100:00100000:3.0:1788330166.701309:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330166.701327:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792371712:0@lo:400:kworker.0 00000100:00100000:3.0:1788330166.701350:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330166.701382:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788330166.701389:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792370560:0@lo:400:kworker.0 00000100:00100000:3.0:1788330166.701414:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330166.701431:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792371072:0@lo:400:kworker.0 00000100:00100000:3.0:1788330166.701454:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330166.701469:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792371584:0@lo:400:kworker.0 00000100:00100000:3.0:1788330166.701489:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330166.701527:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792370688 00000100:00100000:3.0:1788330166.701536:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792370688 00000100:00100000:3.0:1788330166.701596:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792370560 00000100:00100000:3.0:1788330166.701613:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792370560 00000100:00100000:3.0:1788330166.701628:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792371072 00000100:00100000:3.0:1788330166.701630:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792371072 00000100:00100000:3.0:1788330166.701652:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792371584 00000100:00100000:3.0:1788330166.701655:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792371584 00000100:00100000:3.0:1788330166.701673:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788330166.701685:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792370688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330166.701749:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792370688:12345-0@lo:400:kworker.0 Request processed in 65us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330166.701757:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788330166.701778:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788330166.701785:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792370560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330166.701813:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792370560:12345-0@lo:400:kworker.0 Request processed in 29us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330166.701825:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788330166.701838:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788330166.701844:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792371072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330166.701874:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792371072:12345-0@lo:400:kworker.0 Request processed in 31us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330166.701881:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788330166.701893:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788330166.701899:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875199792371584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330166.701924:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875199792371584:12345-0@lo:400:kworker.0 Request processed in 26us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330166.701930:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788330166.701973:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792370560:0@lo:400:kworker.0 00010000:00080000:3.0:1788330166.701987:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7799c00 x1875199792371072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330166.701998:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792371072:0@lo:400:kworker.0 00010000:00080000:3.0:1788330166.702006:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc779a680 x1875199792371584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330166.702013:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792371584:0@lo:400:kworker.0 00000100:00100000:3.0:1788330166.702023:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792370688:0@lo:400:kworker.0 00000100:00100000:0.0:1788330166.702549:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792370816:0@lo:400:kworker.0 00000100:00100000:0.0:1788330166.702609:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330166.702657:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792371328:0@lo:400:kworker.0 00000100:00100000:0.0:1788330166.702683:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330166.702712:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792371840:0@lo:400:kworker.0 00000100:00100000:0.0:1788330166.702734:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330166.702757:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788330166.702763:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792370944:0@lo:400:kworker.0 00000100:00100000:0.0:1788330166.702786:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330166.702803:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792371456:0@lo:400:kworker.0 00000100:00100000:0.0:1788330166.702823:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330166.702854:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792371200 00000100:00100000:0.0:1788330166.702861:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792371200 00000100:00100000:0.0:1788330166.702900:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792371712 00000100:00100000:0.0:1788330166.702903:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792371712 00000100:00100000:0.0:1788330166.702919:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792371328 00000100:00100000:0.0:1788330166.702922:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792371328 00000100:00100000:0.0:1788330166.702933:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792371840 00000100:00100000:0.0:1788330166.702935:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792371840 00000100:00100000:0.0:1788330166.702955:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788330166.702977:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792371200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330166.703036:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792371200:12345-0@lo:400:kworker.0 Request processed in 74us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330166.703043:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788330166.703061:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788330166.703067:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792371712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330166.703097:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792371712:12345-0@lo:400:kworker.0 Request processed in 31us (1746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330166.703104:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788330166.703127:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788330166.703133:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792371328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330166.703205:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792371328:12345-0@lo:400:kworker.0 Request processed in 72us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330166.703211:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788330166.703223:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788330166.703229:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792371840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330166.703255:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792371840:12345-0@lo:400:kworker.0 Request processed in 27us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330166.703261:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788330166.703285:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792370944 00000100:00100000:0.0:1788330166.703288:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792370944 00000100:00100000:0.0:1788330166.703309:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792371456 00000100:00100000:0.0:1788330166.703312:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792371456 00000100:00100000:0.0:1788330166.703328:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788330166.703334:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792370944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330166.703366:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792370944:12345-0@lo:400:kworker.0 Request processed in 33us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330166.703372:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788330166.703383:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788330166.703389:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792371456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330166.703415:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792371456:12345-0@lo:400:kworker.0 Request processed in 27us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330166.703420:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:0.0:1788330166.703467:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330166.703474:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330166.703477:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788330166.703531:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7799f80 x1875199792371200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330166.703547:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792371200:0@lo:400:kworker.0 00000100:00100000:0.0:1788330166.703562:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792371712:0@lo:400:kworker.0 00000100:00100000:0.0:1788330166.703610:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792370944:0@lo:400:kworker.0 00000100:00100000:0.0:1788330166.703621:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792371456:0@lo:400:kworker.0 00010000:00080000:0.0:1788330166.703631:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7798700 x1875199792371328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330166.703640:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792371328:0@lo:400:kworker.0 00000100:00100000:0.0:1788330166.703652:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792371840:0@lo:400:kworker.0 00000100:00100000:3.0:1788330166.707327:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792370816 00000100:00100000:3.0:1788330166.707347:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792370816 00000100:00100000:3.0:1788330166.707443:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788330166.707457:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792370816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330166.707613:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792370816:12345-0@lo:400:kworker.0 Request processed in 159us (5013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330166.707622:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788330166.708242:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792370816:0@lo:400:kworker.0 00000040:00080000:0.0:1788330166.715713:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788330166.746276:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788330167.017439:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330167.017524:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330167.017547:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330167.017568:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330167.017590:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330167.017882:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766066432 00000100:00100000:0.0:1788330167.017896:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766066432 00000100:00100000:0.0:1788330167.018002:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766066688 00000100:00100000:0.0:1788330167.018006:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766066688 00000100:00100000:0.0:1788330167.018023:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766066304 00000100:00100000:0.0:1788330167.018025:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766066304 00000100:00100000:0.0:1788330167.018037:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766066816 00000100:00100000:0.0:1788330167.018039:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766066816 00000100:00100000:0.0:1788330167.018059:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 247 00000100:00100000:0.0:1788330167.018070:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766066432:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330167.018204:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766066432:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 134us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330167.018231:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 247 00000100:00100000:0.0:1788330167.018254:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 248 00000100:00100000:0.0:1788330167.018260:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2412:x1875199766066688:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330167.018291:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2412:x1875199766066688:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 30us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330167.018298:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 248 00000100:00100000:0.0:1788330167.018312:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 249 00000100:00100000:0.0:1788330167.018318:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766066304:12345-192.168.202.50@tcp:400:kworker.0 00000100:00080000:2.0:1788330167.018483:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788330167.018489:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788330167.018678:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 250 00000100:00100000:3.0:1788330167.018689:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2412:x1875199766066816:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330167.018736:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2412:x1875199766066816:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 50us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330167.018742:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 250 00000100:00100000:0.0:1788330167.019043:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766066304:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 723us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330167.019052:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 249 00000100:00100000:0.0:1788330167.019086:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766066560 00000100:00100000:0.0:1788330167.019092:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766066560 00000100:00100000:0.0:1788330167.019209:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 101 00000100:00100000:0.0:1788330167.019217:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766066560:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330167.019246:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766066560:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 31us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330167.019252:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 101 00000100:00080000:2.0:1788330167.035753:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788330167.195364:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788330167.772826:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788330167.774002:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788330168.220444:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330168.731497:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330168.731545:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792371968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330168.731690:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330168.732068:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792371968 00000100:00100000:3.0:1788330168.732081:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792371968 00000100:00100000:3.0:1788330168.732198:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788330168.732212:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792371968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788330168.732257:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330168.732326:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792371968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330168.732334:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788330168.733135:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792371968:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788330168.733222:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330168.733597:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792372096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330168.733662:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330168.733715:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792372096 00000100:00100000:1.0:1788330168.733721:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792372096 00000100:00100000:1.0:1788330168.733786:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788330168.733796:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875199792372096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330168.733815:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330168.733855:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875199792372096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330168.733861:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788330168.733908:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792372096:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788330168.734059:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330168.734745:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefe7eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792372224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330168.734816:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330168.735892:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792372224 00000100:00100000:3.0:1788330168.735905:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792372224 00000100:00100000:3.0:1788330168.735978:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788330168.736003:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792372224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788330168.736049:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788330168.736139:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792372224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330168.736147:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788330168.736708:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefe7eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792372224:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1788330168.742457:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:1.0:1788330169.250797:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330170.267960:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1788330170.268104:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330170.283469:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792372480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330170.283582:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330170.283719:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792372352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330170.283768:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330170.284219:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792372480 00000100:00100000:2.0:1788330170.284228:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792372480 00000100:00100000:2.0:1788330170.284296:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792372352 00000100:00100000:2.0:1788330170.284300:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792372352 00000100:00100000:2.0:1788330170.284322:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788330170.284332:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792372480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330170.284372:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330170.284429:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792372480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330170.284436:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788330170.284457:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788330170.284464:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792372352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788330170.284474:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330170.284508:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792372352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330170.284514:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1788330170.285284:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7db1c00 x1875199792372480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330170.285307:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792372480:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788330170.285321:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7cfdc00 x1875199792372352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330170.285335:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7cfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792372352:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788330170.285366:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330171.291753:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792372608:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788330171.291825:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330171.291838:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330171.292179:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792372608 00000100:00100000:2.0:1788330171.292188:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792372608 00000100:00100000:2.0:1788330171.292462:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788330171.292473:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792372608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788330171.292516:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788330171.292584:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792372608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330171.292601:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788330171.293199:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792372608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788330171.807232:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792372864:0@lo:400:kworker.0 00000100:00100000:2.0:1788330171.807316:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330171.807392:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792373376:0@lo:400:kworker.0 00000100:00100000:2.0:1788330171.807418:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330171.807435:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792373888:0@lo:400:kworker.0 00000100:00100000:2.0:1788330171.807456:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330171.807477:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788330171.807483:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792372992:0@lo:400:kworker.0 00000100:00100000:2.0:1788330171.807518:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330171.807534:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792373504:0@lo:400:kworker.0 00000100:00100000:2.0:1788330171.807569:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330171.807594:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792374016:0@lo:400:kworker.0 00000100:00100000:2.0:1788330171.807621:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330171.808016:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792372864 00000100:00100000:0.0:1788330171.808024:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792372864 00000100:00100000:0.0:1788330171.808083:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792373376 00000100:00100000:0.0:1788330171.808087:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792373376 00000100:00100000:0.0:1788330171.808112:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792373888 00000100:00100000:0.0:1788330171.808115:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792373888 00000100:00100000:0.0:1788330171.808126:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792372992 00000100:00100000:0.0:1788330171.808129:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792372992 00000100:00100000:0.0:1788330171.808144:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788330171.808190:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792372864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330171.808254:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792372864:12345-0@lo:400:kworker.0 Request processed in 66us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330171.808261:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788330171.808282:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788330171.808287:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792373376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330171.808316:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792373376:12345-0@lo:400:kworker.0 Request processed in 29us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330171.808322:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788330171.808335:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788330171.808341:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792373888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330171.808366:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792373888:12345-0@lo:400:kworker.0 Request processed in 26us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330171.808372:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788330171.808383:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788330171.808389:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792372992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330171.808415:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792372992:12345-0@lo:400:kworker.0 Request processed in 26us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330171.808439:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788330171.808475:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792372736:0@lo:400:kworker.0 00000100:00100000:2.0:1788330171.808654:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792372992:0@lo:400:kworker.0 00000100:00100000:2.0:1788330171.808678:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792372864:0@lo:400:kworker.0 00010000:00080000:2.0:1788330171.808690:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc779b480 x1875199792373376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330171.808701:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792373376:0@lo:400:kworker.0 00010000:00080000:2.0:1788330171.808710:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7799c00 x1875199792373888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330171.808730:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792373888:0@lo:400:kworker.0 00000100:00100000:0.0:1788330171.808867:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330171.808903:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792373248:0@lo:400:kworker.0 00000100:00100000:0.0:1788330171.808926:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330171.808944:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792373760:0@lo:400:kworker.0 00000100:00100000:0.0:1788330171.808964:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330171.808984:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788330171.808989:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792373120:0@lo:400:kworker.0 00000100:00100000:0.0:1788330171.809012:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330171.809032:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792373632:0@lo:400:kworker.0 00000100:00100000:0.0:1788330171.809052:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330171.809069:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792374144:0@lo:400:kworker.0 00000100:00100000:0.0:1788330171.809089:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330171.809116:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792373120 00000100:00100000:0.0:1788330171.809121:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792373120 00000100:00100000:0.0:1788330171.809179:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788330171.809187:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792373120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330171.809226:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792373120:12345-0@lo:400:kworker.0 Request processed in 41us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330171.809232:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788330171.809251:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792373504 00000100:00100000:0.0:1788330171.809254:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792373504 00000100:00100000:0.0:1788330171.809276:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792374016 00000100:00100000:0.0:1788330171.809278:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792374016 00000100:00100000:0.0:1788330171.809302:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792373632 00000100:00100000:0.0:1788330171.809306:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792373632 00000100:00100000:0.0:1788330171.809315:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792374144 00000100:00100000:0.0:1788330171.809317:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792374144 00000100:00100000:0.0:1788330171.809329:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788330171.809335:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792373504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330171.809373:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792373504:12345-0@lo:400:kworker.0 Request processed in 38us (1804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330171.809380:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788330171.809392:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788330171.809398:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792374016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330171.809428:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792374016:12345-0@lo:400:kworker.0 Request processed in 31us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330171.809433:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788330171.809443:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788330171.809449:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792373632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330171.809473:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792373632:12345-0@lo:400:kworker.0 Request processed in 24us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330171.809478:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788330171.809488:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788330171.809607:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792373248 00000100:00100000:3.0:1788330171.809611:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792373248 00000100:00100000:3.0:1788330171.809640:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792373760 00000100:00100000:3.0:1788330171.809643:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792373760 00000100:00100000:3.0:1788330171.809662:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788330171.809668:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792373248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330171.809703:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792373248:12345-0@lo:400:kworker.0 Request processed in 34us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330171.809709:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788330171.809733:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788330171.809738:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792373760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330171.809763:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792373760:12345-0@lo:400:kworker.0 Request processed in 26us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330171.809769:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788330171.809828:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792373120:0@lo:400:kworker.0 00010000:00080000:3.0:1788330171.809840:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7799f80 x1875199792373632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330171.809851:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792373632:0@lo:400:kworker.0 00000100:00100000:3.0:1788330171.809861:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792373248:0@lo:400:kworker.0 00000100:00100000:3.0:1788330171.809882:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792373760:0@lo:400:kworker.0 00010000:00080000:3.0:1788330171.809923:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7799500 x1875199792373504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330171.809933:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792373504:0@lo:400:kworker.0 00000100:00100000:3.0:1788330171.809944:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792374016:0@lo:400:kworker.0 00000100:00080000:1.0:1788330171.810133:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788330171.810139:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788330171.810141:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788330171.810224:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792372736 00000100:00100000:2.0:1788330171.810229:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792372736 00000100:00100000:2.0:1788330171.810271:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788330171.810278:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3649:x1875199792372736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330171.810327:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3649:x1875199792372736:12345-0@lo:400:kworker.0 Request processed in 49us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330171.810333:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1788330171.810409:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792372736:0@lo:400:kworker.0 00000100:00100000:0.0:1788330171.810469:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792374144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330171.810785:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792374144:12345-0@lo:400:kworker.0 Request processed in 1290us (1693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330171.810791:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788330171.816989:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788330171.817001:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99eec12eaa00, transno 4294967301 00000100:00100000:1.0:1788330171.817022:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792374144:0@lo:400:kworker.0 00000100:00100000:2.0:1788330172.131638:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330172.131781:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330172.131814:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330172.131860:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330172.131885:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330172.131909:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330172.132085:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766067200 00000100:00100000:1.0:1788330172.132101:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766067200 00000100:00100000:1.0:1788330172.132238:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766067456 00000100:00100000:1.0:1788330172.132242:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766067456 00000100:00100000:1.0:1788330172.132261:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766067072 00000100:00100000:1.0:1788330172.132264:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766067072 00000100:00100000:1.0:1788330172.132280:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766067584 00000100:00100000:1.0:1788330172.132283:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766067584 00000100:00100000:1.0:1788330172.132339:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 257 00000100:00100000:1.0:1788330172.132351:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766067200:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330172.132463:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766067200:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 114us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330172.132472:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 257 00000100:00100000:1.0:1788330172.132492:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 258 00000100:00100000:1.0:1788330172.132499:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2412:x1875199766067456:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330172.132529:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2412:x1875199766067456:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 30us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330172.132536:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 258 00000100:00100000:1.0:1788330172.132563:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 259 00000100:00100000:1.0:1788330172.132571:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766067072:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330172.132600:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766067072:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 31us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330172.132607:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 259 00000100:00100000:1.0:1788330172.132624:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 260 00000100:00100000:1.0:1788330172.132631:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2412:x1875199766067584:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330172.132677:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2412:x1875199766067584:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 47us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330172.132684:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 260 00000100:00100000:3.0:1788330172.135899:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766067328 00000100:00100000:3.0:1788330172.135923:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766067328 00000100:00100000:3.0:1788330172.136021:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 106 00000100:00100000:3.0:1788330172.136034:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766067328:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330172.136189:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766067328:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 157us (4301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330172.136209:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 106 00000100:00080000:2.0:1788330172.137491:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330172.137500:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788330172.137504:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788330172.147125:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766066944 00000100:00100000:0.0:1788330172.147166:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766066944 00000100:00100000:0.0:1788330172.147276:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 375 00000100:00100000:0.0:1788330172.147307:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2412:x1875199766066944:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330172.147595:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2412:x1875199766066944:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 291us (15972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330172.147604:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 375 00010000:00010000:1.0:1788330172.317419:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330173.339504:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330173.852171:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330173.852214:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792374272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330173.852323:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330173.852724:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792374272 00000100:00100000:0.0:1788330173.852735:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792374272 00000100:00100000:0.0:1788330173.852818:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788330173.852831:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792374272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330173.852893:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788330173.852962:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792374272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330173.852971:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788330173.855122:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792374272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330173.856050:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330173.856077:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792374400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330173.856214:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330173.857965:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792374400 00000100:00100000:0.0:1788330173.857987:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792374400 00000100:00100000:0.0:1788330173.858089:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788330173.858104:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792374400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788330173.858182:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330173.858310:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792374400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 211us (2097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330173.858320:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1788330173.859128:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330173.859820:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792374528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788330173.859928:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330173.860069:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792374400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330173.863924:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792374528 00000100:00100000:2.0:1788330173.863952:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792374528 00000100:00100000:2.0:1788330173.864068:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788330173.864081:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792374528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788330173.864121:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330173.864293:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792374528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 214us (4365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330173.864302:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788330173.864388:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792374528:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788330173.865427:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788330174.365913:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330175.391505:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330175.392663:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792374656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330175.392768:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330175.392887:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788330175.392897:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792374784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330175.392926:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330175.393298:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792374656 00000100:00100000:2.0:1788330175.393312:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792374656 00000100:00100000:2.0:1788330175.393408:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792374784 00000100:00100000:2.0:1788330175.393412:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792374784 00000100:00100000:2.0:1788330175.393437:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788330175.393450:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792374656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330175.393541:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330175.393627:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792374656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 178us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330175.393635:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788330175.393658:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788330175.393665:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792374784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788330175.393675:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330175.393702:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792374784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330175.393709:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1788330175.393884:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788330175.393946:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec12eaa00 x1875199792374784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330175.393972:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792374784:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788330175.393989:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6fe5500 x1875199792374656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330175.394003:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792374656:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788330176.411358:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330176.411715:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330176.411761:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792374912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330176.411884:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330176.412179:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792374912 00000100:00100000:2.0:1788330176.412205:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792374912 00000100:00100000:2.0:1788330176.412278:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788330176.412290:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792374912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788330176.412338:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788330176.412413:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792374912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330176.412421:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788330176.412751:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792374912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330176.923496:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792375168:0@lo:400:kworker.0 00000100:00100000:3.0:1788330176.923646:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330176.923730:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792375680:0@lo:400:kworker.0 00000100:00100000:3.0:1788330176.923756:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330176.923778:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792376192:0@lo:400:kworker.0 00000100:00100000:3.0:1788330176.923801:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330176.923849:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788330176.923856:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792375296:0@lo:400:kworker.0 00000100:00100000:3.0:1788330176.923881:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330176.923898:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792375808:0@lo:400:kworker.0 00000100:00100000:3.0:1788330176.924094:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330176.924129:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792376320:0@lo:400:kworker.0 00000100:00100000:3.0:1788330176.924189:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330176.924232:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792375168 00000100:00100000:3.0:1788330176.924242:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792375168 00000100:00100000:3.0:1788330176.924305:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792375680 00000100:00100000:3.0:1788330176.924309:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792375680 00000100:00100000:3.0:1788330176.924337:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792376192 00000100:00100000:3.0:1788330176.924340:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792376192 00000100:00100000:3.0:1788330176.924356:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792375296 00000100:00100000:3.0:1788330176.924358:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792375296 00000100:00100000:3.0:1788330176.924377:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788330176.924388:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792375168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330176.924461:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792375168:12345-0@lo:400:kworker.0 Request processed in 74us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330176.924469:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788330176.924491:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788330176.924498:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792375680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330176.924544:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792375680:12345-0@lo:400:kworker.0 Request processed in 47us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330176.924551:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788330176.924669:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792375424:0@lo:400:kworker.0 00000100:00100000:0.0:1788330176.924712:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330176.924741:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792375936:0@lo:400:kworker.0 00000100:00100000:0.0:1788330176.924766:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330176.924803:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792376448:0@lo:400:kworker.0 00000100:00100000:0.0:1788330176.924828:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330176.924852:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788330176.924860:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792375040:0@lo:400:kworker.0 00000100:00100000:0.0:1788330176.924892:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330176.924916:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792375552:0@lo:400:kworker.0 00000100:00100000:0.0:1788330176.924955:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330176.924968:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792376064:0@lo:400:kworker.0 00000100:00100000:0.0:1788330176.925008:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330176.925038:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792375424 00000100:00100000:0.0:1788330176.925043:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792375424 00000100:00100000:0.0:1788330176.925082:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788330176.925090:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792375424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330176.925137:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792375424:12345-0@lo:400:kworker.0 Request processed in 48us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330176.925145:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788330176.925191:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792375808 00000100:00100000:0.0:1788330176.925195:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792375808 00000100:00100000:0.0:1788330176.925226:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792376320 00000100:00100000:0.0:1788330176.925229:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792376320 00000100:00100000:0.0:1788330176.925248:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792375936 00000100:00100000:0.0:1788330176.925250:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792375936 00000100:00100000:0.0:1788330176.925263:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792376448 00000100:00100000:0.0:1788330176.925265:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792376448 00000100:00100000:0.0:1788330176.925281:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788330176.925287:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792375808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330176.925323:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792375808:12345-0@lo:400:kworker.0 Request processed in 36us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330176.925341:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788330176.925356:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788330176.925362:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792376320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330176.925408:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792376320:12345-0@lo:400:kworker.0 Request processed in 45us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330176.925415:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788330176.925429:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788330176.925436:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792375936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330176.925465:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792375936:12345-0@lo:400:kworker.0 Request processed in 30us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330176.925471:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788330176.925483:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788330176.925490:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792376448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330176.925534:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792376448:12345-0@lo:400:kworker.0 Request processed in 45us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330176.925540:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788330176.925750:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792375040 00000100:00100000:0.0:1788330176.925755:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792375040 00000100:00100000:0.0:1788330176.925788:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788330176.925795:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3646:x1875199792375040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330176.925829:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3646:x1875199792375040:12345-0@lo:400:kworker.0 Request processed in 35us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330176.925835:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788330176.925896:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792375040:0@lo:400:kworker.0 00000100:00100000:0.0:1788330176.926057:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792375424:0@lo:400:kworker.0 00010000:00080000:0.0:1788330176.926077:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc9d180 x1875199792375936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330176.926089:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792375936:0@lo:400:kworker.0 00000100:00100000:0.0:1788330176.926099:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792376448:0@lo:400:kworker.0 00000100:00100000:3.0:1788330176.926274:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792375552 00000100:00100000:3.0:1788330176.926280:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792375552 00000100:00100000:3.0:1788330176.926310:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792376064 00000100:00100000:3.0:1788330176.926320:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792376064 00000100:00100000:3.0:1788330176.926342:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788330176.926351:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792376192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330176.926397:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792376192:12345-0@lo:400:kworker.0 Request processed in 48us (2594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330176.926405:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788330176.926420:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788330176.926427:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792375296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330176.926459:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792375296:12345-0@lo:400:kworker.0 Request processed in 33us (2577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330176.926465:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788330176.926478:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788330176.926483:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792375552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330176.926529:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792375552:12345-0@lo:400:kworker.0 Request processed in 45us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330176.926535:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788330176.926896:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792375552:0@lo:400:kworker.0 00000100:00080000:0.0:1788330176.928740:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330176.928755:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330176.928758:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788330176.933264:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788330176.933304:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792376064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330176.933473:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792376064:12345-0@lo:400:kworker.0 Request processed in 192us (8463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330176.933482:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788330176.934472:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6605c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792375296:0@lo:400:kworker.0 00010000:00080000:2.0:1788330176.934498:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc9df80 x1875199792375808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330176.934526:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792375808:0@lo:400:kworker.0 00000100:00100000:2.0:1788330176.934549:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792376320:0@lo:400:kworker.0 00000100:00100000:2.0:1788330176.934627:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792375168:0@lo:400:kworker.0 00010000:00080000:2.0:1788330176.934647:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc9fb80 x1875199792375680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330176.934655:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792375680:0@lo:400:kworker.0 00010000:00080000:2.0:1788330176.934668:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc9f480 x1875199792376192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330176.934700:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792376192:0@lo:400:kworker.0 00000100:00100000:2.0:1788330176.935295:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792376064:0@lo:400:kworker.0 00000100:00100000:1.0:1788330177.251369:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330177.251433:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330177.251465:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330177.251511:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766067968 00000100:00100000:1.0:1788330177.251533:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766067968 00000100:00100000:1.0:1788330177.251687:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766067840 00000100:00100000:1.0:1788330177.251691:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766067840 00000100:00100000:1.0:1788330177.251722:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 267 00000100:00100000:1.0:1788330177.251736:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766067968:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330177.251841:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766067968:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 109us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330177.251853:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 267 00000100:00100000:1.0:1788330177.251876:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 268 00000100:00100000:1.0:1788330177.251884:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766067840:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330177.251913:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766067840:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 30us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330177.251920:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 268 00000100:00080000:1.0:1788330177.251943:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788330177.251949:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788330177.252007:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766067712 00000100:00100000:3.0:1788330177.252012:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766067712 00000100:00100000:3.0:1788330177.252057:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 377 00000100:00100000:3.0:1788330177.252065:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2412:x1875199766067712:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330177.252097:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2412:x1875199766067712:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 34us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330177.252105:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 377 00000100:00100000:1.0:1788330177.277050:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330177.277087:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330177.277128:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330177.277248:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766068224 00000100:00100000:2.0:1788330177.277263:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766068224 00000100:00100000:2.0:1788330177.277346:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766068352 00000100:00100000:2.0:1788330177.277349:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766068352 00000100:00100000:2.0:1788330177.277370:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 269 00000100:00100000:2.0:1788330177.277381:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766068224:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330177.277496:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766068224:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 115us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330177.277519:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 269 00000100:00100000:2.0:1788330177.277562:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 270 00000100:00100000:2.0:1788330177.277570:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766068352:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330177.277600:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766068352:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 32us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330177.277607:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 270 00000100:00100000:0.0:1788330177.278747:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766068096 00000100:00100000:0.0:1788330177.278767:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766068096 00000100:00100000:0.0:1788330177.278856:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:0.0:1788330177.278867:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2409:x1875199766068096:12345-192.168.202.50@tcp:9:kworker.0 00000020:00000080:0.0:1788330177.278901:0:8440:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd10c6 00000100:00080000:0.0:1788330177.278913:0:8440:0:(import.c:65:import_set_state_nolock()) ffff99eef6dc9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788330177.278971:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1788330177.279210:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+2:2409:x1875199766068096:12345-192.168.202.50@tcp:9:kworker.0 Request processed in 344us (2173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330177.279218:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 27 00010000:00010000:0.0:1788330177.279251:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788330177.279531:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788330177.279548:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788330177.279552:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788330177.435825:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788330178.012699:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788330178.013429:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788330178.465594:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330178.971625:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330178.971943:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330178.971977:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6e49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792376704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330178.972090:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330178.972213:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792376704 00000100:00100000:0.0:1788330178.972238:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792376704 00000100:00100000:0.0:1788330178.972304:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788330178.972316:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792376704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330178.972364:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788330178.972420:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792376704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330178.972429:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788330178.972504:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6e49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792376704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330178.973117:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788330178.973133:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792376832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788330178.973213:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330178.973311:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792376832 00000100:00100000:2.0:1788330178.973317:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792376832 00000100:00100000:2.0:1788330178.973387:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788330178.973398:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792376832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788330178.973428:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330178.973475:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792376832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330178.973511:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1788330178.973868:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330178.973906:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792376832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788330178.974076:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792376576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330178.974123:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330178.974265:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792376576 00000100:00100000:0.0:1788330178.974271:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792376576 00000100:00100000:0.0:1788330178.974367:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788330178.974376:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792376576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788330178.974391:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330178.974440:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792376576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330178.974447:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788330178.974645:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792376576:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788330178.974888:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788330179.484235:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330180.512277:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330180.517840:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6e49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792377088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330180.517957:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330180.518070:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330180.518078:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792376960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330180.518104:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330180.518356:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792377088 00000100:00100000:0.0:1788330180.518368:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792377088 00000100:00100000:0.0:1788330180.518449:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792376960 00000100:00100000:0.0:1788330180.518453:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792376960 00000100:00100000:0.0:1788330180.518483:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788330180.518495:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792377088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788330180.518537:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330180.518598:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792377088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330180.518607:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788330180.518645:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788330180.518651:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792376960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788330180.518663:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330180.518705:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792376960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330180.518711:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1788330180.520654:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788330180.520748:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc76dc700 x1875199792376960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330180.520781:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792376960:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788330180.520799:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6e49c00 x1875199792377088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330180.520811:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6e49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792377088:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788330181.531637:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330181.532082:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330181.537337:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792377216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330181.537470:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330181.537780:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792377216 00000100:00100000:2.0:1788330181.537793:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792377216 00000100:00100000:2.0:1788330181.537872:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788330181.537888:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792377216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788330181.537954:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788330181.538026:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792377216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330181.538034:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788330181.538558:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792377216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330182.045413:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792377344:0@lo:400:kworker.0 00000100:00100000:1.0:1788330182.045551:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330182.046087:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792377344 00000100:00100000:0.0:1788330182.046099:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792377344 00000100:00100000:0.0:1788330182.046185:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788330182.046199:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3649:x1875199792377344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330182.046379:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792377728:0@lo:400:kworker.0 00000100:00100000:2.0:1788330182.046425:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330182.046486:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792377472:0@lo:400:kworker.0 00000100:00100000:2.0:1788330182.046692:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330182.046716:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330182.046722:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792377600:0@lo:400:kworker.0 00000100:00100000:2.0:1788330182.046763:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330182.046798:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792377600 00000100:00100000:2.0:1788330182.046803:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792377600 00000100:00100000:2.0:1788330182.046841:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788330182.046849:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792377600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330182.046896:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792377600:12345-0@lo:400:kworker.0 Request processed in 47us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330182.047268:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788330182.047339:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792377600:0@lo:400:kworker.0 00000100:00100000:2.0:1788330182.047389:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792377728 00000100:00100000:2.0:1788330182.047394:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792377728 00000100:00100000:2.0:1788330182.047428:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792377472 00000100:00100000:2.0:1788330182.047431:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792377472 00000100:00100000:2.0:1788330182.047463:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788330182.047471:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792377728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330182.047527:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792377728:12345-0@lo:400:kworker.0 Request processed in 57us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330182.047535:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788330182.047548:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788330182.047554:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792377472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330182.047584:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792377472:12345-0@lo:400:kworker.0 Request processed in 31us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330182.047590:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788330182.047628:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792377728:0@lo:400:kworker.0 00000100:00100000:2.0:1788330182.047653:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792377472:0@lo:400:kworker.0 00000100:00100000:3.0:1788330182.061713:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792378112:0@lo:400:kworker.0 00000100:00100000:3.0:1788330182.061825:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330182.061871:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792378624:0@lo:400:kworker.0 00000100:00100000:3.0:1788330182.061899:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330182.062125:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3649:x1875199792377344:12345-0@lo:400:kworker.0 Request processed in 15925us (16570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330182.062140:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788330182.062342:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792377984:0@lo:400:kworker.0 00000100:00100000:3.0:1788330182.063407:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792378112 00000100:00100000:3.0:1788330182.063423:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792378112 00000100:00100000:3.0:1788330182.063849:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792378624 00000100:00100000:3.0:1788330182.063854:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792378624 00000100:00100000:3.0:1788330182.063888:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788330182.063899:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792378112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330182.064065:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330182.064104:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792378496:0@lo:400:kworker.0 00000100:00100000:0.0:1788330182.064177:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330182.064204:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792377984 00000100:00100000:0.0:1788330182.064207:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792377984 00000100:00100000:0.0:1788330182.064227:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792378496 00000100:00100000:0.0:1788330182.064229:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792378496 00000100:00100000:0.0:1788330182.064242:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788330182.064260:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792378624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330182.064328:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792378624:12345-0@lo:400:kworker.0 Request processed in 79us (2428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330182.064350:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788330182.064368:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788330182.064373:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792377984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330182.064407:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792377984:12345-0@lo:400:kworker.0 Request processed in 34us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330182.064413:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788330182.064426:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788330182.064432:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792378496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330182.064470:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792378496:12345-0@lo:400:kworker.0 Request processed in 38us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330182.064476:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788330182.064667:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792378112:12345-0@lo:400:kworker.0 Request processed in 769us (2842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330182.064674:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:3.0:1788330182.064695:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788330182.064700:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788330182.064829:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792377984:0@lo:400:kworker.0 00000100:00100000:0.0:1788330182.064839:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792378496:0@lo:400:kworker.0 00000100:00100000:2.0:1788330182.065514:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792378240:0@lo:400:kworker.0 00000100:00100000:2.0:1788330182.065571:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330182.065614:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792378752:0@lo:400:kworker.0 00000100:00100000:2.0:1788330182.065640:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330182.065680:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788330182.065689:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792377856:0@lo:400:kworker.0 00000100:00100000:2.0:1788330182.065718:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330182.065751:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792378368:0@lo:400:kworker.0 00000100:00100000:2.0:1788330182.065774:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330182.065809:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792378880:0@lo:400:kworker.0 00000100:00100000:2.0:1788330182.065834:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330182.065872:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792378240 00000100:00100000:2.0:1788330182.065879:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792378240 00000100:00100000:2.0:1788330182.067402:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792378752 00000100:00100000:2.0:1788330182.067417:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792378752 00000100:00100000:2.0:1788330182.067444:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792378368 00000100:00100000:2.0:1788330182.067446:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792378368 00000100:00100000:2.0:1788330182.067474:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792378880 00000100:00100000:2.0:1788330182.067477:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792378880 00010000:00080000:3.0:1788330182.067728:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc76df100 x1875199792378112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330182.067811:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792378112:0@lo:400:kworker.0 00010000:00080000:3.0:1788330182.067851:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eed82d1500 x1875199792378624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330182.067859:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792378624:0@lo:400:kworker.0 00000100:00100000:0.0:1788330182.069967:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788330182.070005:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792378240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330182.070405:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788330182.070419:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792378752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330182.070522:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788330182.070534:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792378368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330182.074753:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792377344:0@lo:400:kworker.0 00000100:00100000:1.0:1788330182.075185:0:8632:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:1.0:1788330182.075202:0:8632:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00000100:00080000:1.0:1788330182.075236:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788330182.075243:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330182.078646:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792377856 00000100:00100000:1.0:1788330182.078680:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792377856 00000100:00100000:1.0:1788330182.078966:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788330182.078996:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792377856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330182.079208:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792378240:12345-0@lo:400:kworker.0 Request processed in 9223us (13633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330182.079220:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788330182.079263:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788330182.079274:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792378880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330182.083255:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792378752:12345-0@lo:400:kworker.0 Request processed in 12811us (17584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330182.083296:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788330182.084114:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792378368:12345-0@lo:400:kworker.0 Request processed in 13580us (18334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330182.084126:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788330182.084411:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792377856:12345-0@lo:400:kworker.0 Request processed in 5416us (18689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330182.084422:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788330182.084880:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792377856:0@lo:400:kworker.0 00010000:00080000:2.0:1788330182.088685:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eed82d2d80 x1875199792378368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330182.088714:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792378368:0@lo:400:kworker.0 00000100:00100000:0.0:1788330182.088889:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792378880:12345-0@lo:400:kworker.0 Request processed in 9614us (23049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330182.089184:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788330182.089472:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792378880:0@lo:400:kworker.0 00010000:00080000:2.0:1788330182.089566:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc76dc700 x1875199792378240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330182.089578:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792378240:0@lo:400:kworker.0 00000100:00100000:2.0:1788330182.089598:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792378752:0@lo:400:kworker.0 00000100:00100000:3.0:1788330182.370773:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330182.370828:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330182.370871:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330182.370897:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330182.370926:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330182.370961:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766068736 00000100:00100000:3.0:1788330182.370973:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766068736 00000100:00100000:3.0:1788330182.371050:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766068992 00000100:00100000:3.0:1788330182.371054:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766068992 00000100:00100000:3.0:1788330182.371072:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766068608 00000100:00100000:3.0:1788330182.371075:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766068608 00000100:00100000:3.0:1788330182.371089:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766068864 00000100:00100000:3.0:1788330182.371092:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766068864 00000100:00100000:3.0:1788330182.371109:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 277 00000100:00100000:3.0:1788330182.371121:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766068736:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330182.371255:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766068736:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 136us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330182.371264:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 277 00000100:00100000:3.0:1788330182.371287:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 278 00000100:00100000:3.0:1788330182.371295:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766068992:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330182.371339:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766068992:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 45us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330182.371348:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 278 00000100:00100000:3.0:1788330182.371363:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 279 00000100:00100000:3.0:1788330182.371384:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766068608:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330182.371412:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766068608:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 29us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330182.371418:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 279 00000100:00100000:3.0:1788330182.371430:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 280 00000100:00100000:3.0:1788330182.371436:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766068864:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330182.371483:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766068864:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 46us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330182.371490:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 280 00000100:00100000:1.0:1788330182.372210:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766068480 00000100:00100000:1.0:1788330182.372219:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766068480 00000100:00100000:1.0:1788330182.372276:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 379 00000100:00100000:1.0:1788330182.372285:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed068c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2411:x1875199766068480:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330182.372343:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed068c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2411:x1875199766068480:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 60us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330182.372350:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 379 00000100:00080000:1.0:1788330182.372387:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788330182.372393:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788330182.555689:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788330183.076512:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00000020:00000080:3.0:1788330183.076528:0:9518:0:(genops.c:885:class_export_put()) final put ffff99eef6dce800/f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00000020:00000080:1.0:1788330183.076613:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef6dce800/f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 for lustre-OST0001 00000020:00000080:1.0:1788330183.076692:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eef6dc9800 for lustre-OST0001 00010000:00010000:1.0:1788330183.579456:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330184.091664:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792379136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330184.091770:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330184.091863:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788330184.091871:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792379008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788330184.091902:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330184.091996:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792379136 00000100:00100000:2.0:1788330184.092008:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792379136 00000100:00100000:2.0:1788330184.092075:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788330184.092117:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792379136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788330184.092198:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788330184.092271:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792379136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 158us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330184.092280:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788330184.092540:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792379136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330184.093041:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792379264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330184.093045:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792379008 00000100:00100000:0.0:1788330184.093052:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792379008 00000100:00100000:2.0:1788330184.093089:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788330184.093189:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330184.106631:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792379264 00000100:00100000:3.0:1788330184.106654:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792379264 00000100:00100000:3.0:1788330184.106769:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788330184.106785:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792379008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788330184.106836:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330184.107015:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792379008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 226us (15103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330184.107046:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788330184.107074:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788330184.107081:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792379264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330184.107093:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330184.107135:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792379264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (14046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330184.107142:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788330184.107239:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792379264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330184.107298:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792379008:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788330184.107394:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788330184.603357:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330185.627679:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792379392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330185.627776:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330185.627937:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330185.628067:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330185.628079:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792379520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330185.628112:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330185.635388:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792379392 00000100:00100000:2.0:1788330185.635415:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792379392 00000100:00100000:2.0:1788330185.635750:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792379520 00000100:00100000:2.0:1788330185.635755:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792379520 00000100:00100000:3.0:1788330185.636537:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788330185.636561:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792379392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788330185.636609:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330185.636736:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792379392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 185us (8960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330185.636743:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:3.0:1788330185.636905:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef6e49f80 x1875199792379392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330185.636933:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792379392:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788330185.644118:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330185.645559:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788330185.645582:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792379520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330185.645625:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330185.645745:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792379520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (17631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330185.645752:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:1.0:1788330185.646575:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eed82d3b80 x1875199792379520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330185.646609:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792379520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330186.652434:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792379648:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788330186.652482:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330186.652587:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330186.653048:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792379648 00000100:00100000:0.0:1788330186.653062:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792379648 00000100:00100000:0.0:1788330186.653126:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788330186.653139:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792379648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788330186.653228:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788330186.653321:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792379648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 183us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330186.653329:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788330186.654660:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792379648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330187.166442:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792380032:0@lo:400:kworker.0 00000100:00100000:3.0:1788330187.166547:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330187.166630:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792380544:0@lo:400:kworker.0 00000100:00100000:3.0:1788330187.166661:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330187.166698:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec3742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792381056:0@lo:400:kworker.0 00000100:00100000:3.0:1788330187.166723:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330187.166752:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788330187.166759:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792380160:0@lo:400:kworker.0 00000100:00100000:3.0:1788330187.166784:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330187.166802:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792380672:0@lo:400:kworker.0 00000100:00100000:3.0:1788330187.166841:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330187.166865:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec3741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792381184:0@lo:400:kworker.0 00000100:00100000:3.0:1788330187.166886:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330187.166927:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792380032 00000100:00100000:3.0:1788330187.166938:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792380032 00000100:00100000:3.0:1788330187.167000:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788330187.167012:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792380032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330187.167080:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792380032:12345-0@lo:400:kworker.0 Request processed in 69us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330187.167087:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788330187.167116:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792380544 00000100:00100000:3.0:1788330187.167120:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792380544 00000100:00100000:3.0:1788330187.167197:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792381056 00000100:00100000:3.0:1788330187.167200:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792381056 00000100:00100000:3.0:1788330187.167221:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792380160 00000100:00100000:3.0:1788330187.167224:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792380160 00000100:00100000:3.0:1788330187.167242:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788330187.167248:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792380544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330187.167281:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792380544:12345-0@lo:400:kworker.0 Request processed in 34us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330187.167287:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788330187.167310:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788330187.167316:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792381056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330187.167346:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792381056:12345-0@lo:400:kworker.0 Request processed in 31us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330187.167352:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788330187.167363:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788330187.167369:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792380160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330187.167395:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792380160:12345-0@lo:400:kworker.0 Request processed in 26us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330187.167401:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788330187.167442:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792380672 00000100:00100000:3.0:1788330187.167446:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792380672 00000100:00100000:3.0:1788330187.167484:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792381184 00000100:00100000:3.0:1788330187.167487:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792381184 00000100:00100000:3.0:1788330187.167512:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788330187.167520:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792380672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330187.167553:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792380672:12345-0@lo:400:kworker.0 Request processed in 35us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330187.167559:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788330187.167570:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788330187.167576:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792381184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330187.167603:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792381184:12345-0@lo:400:kworker.0 Request processed in 27us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330187.167608:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1788330187.167631:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330187.167637:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330187.167640:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788330187.167707:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792380160:0@lo:400:kworker.0 00010000:00080000:3.0:1788330187.167724:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef59de300 x1875199792380672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330187.167734:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792380672:0@lo:400:kworker.0 00000100:00100000:3.0:1788330187.167744:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec3741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792381184:0@lo:400:kworker.0 00000100:00100000:3.0:1788330187.167755:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792380032:0@lo:400:kworker.0 00010000:00080000:3.0:1788330187.167766:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef59ded80 x1875199792380544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330187.167774:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792380544:0@lo:400:kworker.0 00010000:00080000:3.0:1788330187.167783:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec3742d80 x1875199792381056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330187.167791:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec3742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792381056:0@lo:400:kworker.0 00000100:00100000:0.0:1788330187.168466:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792379776:0@lo:400:kworker.0 00000100:00100000:0.0:1788330187.168535:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330187.168591:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792380288:0@lo:400:kworker.0 00000100:00100000:0.0:1788330187.168626:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330187.168654:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec3742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792380800:0@lo:400:kworker.0 00000100:00100000:0.0:1788330187.168678:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330187.168694:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec3740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792381312:0@lo:400:kworker.0 00000100:00100000:0.0:1788330187.168717:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330187.168744:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788330187.168751:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792379904:0@lo:400:kworker.0 00000100:00100000:0.0:1788330187.168779:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330187.168797:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792380416:0@lo:400:kworker.0 00000100:00100000:0.0:1788330187.168833:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330187.168864:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec3742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792380928:0@lo:400:kworker.0 00000100:00100000:0.0:1788330187.168889:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330187.168969:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792380288 00000100:00100000:0.0:1788330187.168978:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792380288 00000100:00100000:0.0:1788330187.169024:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788330187.169034:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792380288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330187.169092:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792380288:12345-0@lo:400:kworker.0 Request processed in 60us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330187.169100:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788330187.169126:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792380800 00000100:00100000:0.0:1788330187.169130:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792380800 00000100:00100000:0.0:1788330187.169187:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792381312 00000100:00100000:0.0:1788330187.169191:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792381312 00000100:00100000:0.0:1788330187.169210:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788330187.169216:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792380800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330187.169248:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792380800:12345-0@lo:400:kworker.0 Request processed in 32us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330187.169254:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788330187.169264:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788330187.169270:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792381312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330187.169298:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792381312:12345-0@lo:400:kworker.0 Request processed in 27us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330187.169303:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788330187.169340:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792380288:0@lo:400:kworker.0 00010000:00080000:0.0:1788330187.169354:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec3742300 x1875199792380800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330187.169379:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec3742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792380800:0@lo:400:kworker.0 00000100:00100000:0.0:1788330187.169392:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec3740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792381312:0@lo:400:kworker.0 00000100:00100000:3.0:1788330187.170712:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792379776 00000100:00100000:3.0:1788330187.170729:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792379776 00000100:00100000:3.0:1788330187.170925:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788330187.170939:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec2d19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3648:x1875199792379776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330187.171041:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec2d19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3648:x1875199792379776:12345-0@lo:400:kworker.0 Request processed in 105us (2506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330187.171049:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788330187.171221:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792379904 00000100:00100000:3.0:1788330187.171226:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792379904 00000100:00100000:3.0:1788330187.171258:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792380416 00000100:00100000:3.0:1788330187.171261:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792380416 00000100:00100000:3.0:1788330187.171286:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792380928 00000100:00100000:3.0:1788330187.171303:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792380928 00000100:00100000:3.0:1788330187.171323:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788330187.171330:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792379904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330187.171370:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792379904:12345-0@lo:400:kworker.0 Request processed in 41us (2590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330187.171377:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788330187.171391:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788330187.171398:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792380416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330187.171441:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792380416:12345-0@lo:400:kworker.0 Request processed in 44us (2608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330187.171447:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788330187.171460:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788330187.171465:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792380928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330187.171492:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792380928:12345-0@lo:400:kworker.0 Request processed in 27us (2602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330187.171498:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:3.0:1788330187.171530:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788330187.171537:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330187.171540:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330187.178179:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792379904:0@lo:400:kworker.0 00000100:00100000:0.0:1788330187.178209:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792380416:0@lo:400:kworker.0 00000100:00100000:0.0:1788330187.178225:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec3742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792380928:0@lo:400:kworker.0 00000100:00100000:0.0:1788330187.178239:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792379776:0@lo:400:kworker.0 00000100:00100000:1.0:1788330187.501482:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330187.501535:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330187.501748:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766069120 00000100:00100000:3.0:1788330187.501761:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766069120 00000100:00100000:3.0:1788330187.501831:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 381 00000100:00100000:3.0:1788330187.501843:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec2d19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2413:x1875199766069120:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330187.501912:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330187.502603:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766069376 00000100:00100000:2.0:1788330187.502610:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766069376 00000100:00100000:2.0:1788330187.502772:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766069632 00000100:00100000:2.0:1788330187.502776:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766069632 00000100:00100000:2.0:1788330187.502802:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 287 00000100:00100000:2.0:1788330187.502811:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766069376:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330187.509673:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec2d19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2413:x1875199766069120:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 7812us (8188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330187.509692:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 381 00000100:00100000:3.0:1788330187.509798:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 288 00000100:00100000:3.0:1788330187.509815:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766069632:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330187.509878:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766069632:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 70us (7967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330187.509885:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 288 00000100:00080000:3.0:1788330187.509917:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788330187.517923:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330187.517993:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330187.518032:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766069248 00000100:00100000:1.0:1788330187.518045:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766069248 00000100:00100000:1.0:1788330187.518124:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766069504 00000100:00100000:1.0:1788330187.518128:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766069504 00000100:00100000:1.0:1788330187.518185:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 289 00000100:00100000:1.0:1788330187.518199:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766069248:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330187.518309:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766069248:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 112us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330187.518318:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 289 00000100:00100000:1.0:1788330187.518339:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 290 00000100:00100000:1.0:1788330187.518347:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec975b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766069504:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330187.518375:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec975b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766069504:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 29us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330187.518382:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 290 00000100:00080000:1.0:1788330187.518413:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330187.518804:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766069376:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 15990us (17264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330187.518814:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 287 00010000:00010000:2.0:1788330187.688784:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788330188.253695:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788330188.254482:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788330188.715769:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330189.214410:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330189.214449:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec975a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792381440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330189.214569:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330189.214657:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788330189.214668:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6e4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792381568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330189.214700:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330189.214745:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792381440 00000100:00100000:0.0:1788330189.214755:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792381440 00000100:00100000:0.0:1788330189.214830:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792381568 00000100:00100000:0.0:1788330189.214834:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792381568 00000100:00100000:0.0:1788330189.214856:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788330189.214867:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792381440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788330189.214912:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330189.214985:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792381440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330189.214994:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788330189.215037:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788330189.215045:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792381568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788330189.215055:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330189.215086:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792381568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330189.215092:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1788330189.215111:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330189.215201:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6e4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792381568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330189.215246:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec975a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792381440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788330189.215655:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330189.215682:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792381696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330189.215732:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330189.215822:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792381696 00000100:00100000:2.0:1788330189.215831:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792381696 00000100:00100000:2.0:1788330189.215884:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788330189.215895:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec975aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792381696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788330189.215935:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788330189.216005:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec975aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792381696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330189.216012:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788330189.216054:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792381696:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788330189.723360:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330190.747625:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec975ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792381824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330190.747703:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330190.747803:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792381824 00000100:00100000:1.0:1788330190.747812:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792381824 00000100:00100000:1.0:1788330190.747870:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788330190.747881:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792381824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330190.747917:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330190.747971:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792381824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330190.747978:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1788330190.748000:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788330190.748031:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec975ad80 x1875199792381824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330190.748051:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec975ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792381824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330190.750410:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788330190.750433:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec975ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792381952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330190.750496:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330190.750691:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792381952 00000100:00100000:0.0:1788330190.750699:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792381952 00000100:00100000:0.0:1788330190.750769:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788330190.750780:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792381952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788330190.750800:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330190.750843:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792381952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330190.750851:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1788330190.750871:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788330190.751110:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec975ad80 x1875199792381952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330190.751130:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec975ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792381952:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788330190.754812:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330191.773038:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330191.773845:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792382080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330191.773927:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330191.774052:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792382080 00000100:00100000:2.0:1788330191.774062:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792382080 00000100:00100000:2.0:1788330191.774127:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788330191.774139:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec975ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792382080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788330191.774248:0:7831:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788330191.774298:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec975ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792382080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 162us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330191.774306:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788330191.780321:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792382080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330192.284037:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792382336:0@lo:400:kworker.0 00000100:00100000:1.0:1788330192.284128:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330192.284233:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792382848:0@lo:400:kworker.0 00000100:00100000:1.0:1788330192.284268:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330192.284294:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792383360:0@lo:400:kworker.0 00000100:00100000:1.0:1788330192.284319:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330192.284346:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788330192.284352:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792382464:0@lo:400:kworker.0 00000100:00100000:1.0:1788330192.284388:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330192.284406:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792382976:0@lo:400:kworker.0 00000100:00100000:1.0:1788330192.284428:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330192.284444:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792383488:0@lo:400:kworker.0 00000100:00100000:1.0:1788330192.284464:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330192.284495:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792382336 00000100:00100000:1.0:1788330192.284504:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792382336 00000100:00100000:1.0:1788330192.284558:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792382848 00000100:00100000:1.0:1788330192.284562:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792382848 00000100:00100000:1.0:1788330192.284584:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792383360 00000100:00100000:1.0:1788330192.284586:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792383360 00000100:00100000:1.0:1788330192.284598:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792382976 00000100:00100000:1.0:1788330192.285038:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792382976 00000100:00100000:1.0:1788330192.285064:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792383488 00000100:00100000:1.0:1788330192.285067:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792383488 00000100:00100000:1.0:1788330192.285145:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788330192.285187:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec975a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792382336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330192.285321:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec975a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792382336:12345-0@lo:400:kworker.0 Request processed in 136us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330192.285341:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788330192.285369:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788330192.285376:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792382848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330192.285406:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9759c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792382848:12345-0@lo:400:kworker.0 Request processed in 31us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330192.285413:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788330192.285426:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788330192.285432:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792383360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330192.285459:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9758700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792383360:12345-0@lo:400:kworker.0 Request processed in 27us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330192.285465:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788330192.285476:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788330192.285482:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792382976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330192.285507:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9759500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792382976:12345-0@lo:400:kworker.0 Request processed in 26us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330192.285512:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788330192.285686:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788330192.285701:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792383488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330192.285735:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9758380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792383488:12345-0@lo:400:kworker.0 Request processed in 38us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330192.285741:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788330192.285792:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792382464 00000100:00100000:2.0:1788330192.285797:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792382464 00000100:00100000:2.0:1788330192.285831:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788330192.285906:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec975bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792382464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330192.285943:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec975bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792382464:12345-0@lo:400:kworker.0 Request processed in 106us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330192.285949:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788330192.286139:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792382464:0@lo:400:kworker.0 00010000:00080000:2.0:1788330192.286178:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffd6b100 x1875199792382976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330192.286189:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792382976:0@lo:400:kworker.0 00010000:00080000:2.0:1788330192.286200:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffd6aa00 x1875199792383488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330192.286207:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792383488:0@lo:400:kworker.0 00000100:00100000:2.0:1788330192.286217:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792382336:0@lo:400:kworker.0 00000100:00100000:2.0:1788330192.286227:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792382848:0@lo:400:kworker.0 00000100:00100000:2.0:1788330192.286236:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792383360:0@lo:400:kworker.0 00000100:00100000:0.0:1788330192.286353:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792382208:0@lo:400:kworker.0 00000100:00100000:0.0:1788330192.286412:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330192.286446:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792382720:0@lo:400:kworker.0 00000100:00100000:0.0:1788330192.286478:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330192.286499:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792383232:0@lo:400:kworker.0 00000100:00100000:0.0:1788330192.286683:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330192.286705:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792383744:0@lo:400:kworker.0 00000100:00100000:0.0:1788330192.286738:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330192.286761:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788330192.286768:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792382592:0@lo:400:kworker.0 00000100:00100000:0.0:1788330192.286793:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330192.286810:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792383104:0@lo:400:kworker.0 00000100:00100000:0.0:1788330192.286829:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330192.287700:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792383616:0@lo:400:kworker.0 00000100:00100000:0.0:1788330192.287738:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330192.287821:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792382592 00000100:00100000:3.0:1788330192.287828:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792382592 00000100:00100000:3.0:1788330192.287948:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788330192.287958:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792382592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330192.288176:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792382592:12345-0@lo:400:kworker.0 Request processed in 219us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330192.288183:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788330192.288209:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792382208 00000100:00100000:3.0:1788330192.288212:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792382208 00000100:00100000:0.0:1788330192.288408:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792382592:0@lo:400:kworker.0 00000100:00100000:2.0:1788330192.288449:0:13409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792383232 00000100:00100000:2.0:1788330192.288454:0:13409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792383232 00000100:00100000:2.0:1788330192.288486:0:13409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792383744 00000100:00100000:2.0:1788330192.288489:0:13409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792383744 00000100:00100000:2.0:1788330192.288508:0:13409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792383104 00000100:00100000:2.0:1788330192.288511:0:13409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792383104 00000100:00100000:3.0:1788330192.288826:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788330192.288927:0:13409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792383616 00000100:00100000:2.0:1788330192.288931:0:13409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792383616 00000100:00100000:2.0:1788330192.288947:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788330192.288952:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792383232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330192.289170:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788330192.289178:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792383744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330192.289226:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792382208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330192.289366:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792382720 00000100:00100000:1.0:1788330192.289372:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792382720 00000100:00100000:1.0:1788330192.289405:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788330192.289412:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792382720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330192.289650:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792383744:12345-0@lo:400:kworker.0 Request processed in 472us (2910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330192.289657:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788330192.289674:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788330192.289681:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792383104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330192.289710:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792383104:12345-0@lo:400:kworker.0 Request processed in 31us (2880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330192.289716:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788330192.289727:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788330192.289733:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792383616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330192.289760:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792383616:12345-0@lo:400:kworker.0 Request processed in 28us (2022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330192.289775:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:0.0:1788330192.289824:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffd68000 x1875199792383104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330192.289848:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792383104:0@lo:400:kworker.0 00000100:00100000:0.0:1788330192.289861:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792383616:0@lo:400:kworker.0 00000100:00100000:0.0:1788330192.289871:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792383744:0@lo:400:kworker.0 00000100:00080000:0.0:1788330192.289970:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330192.289975:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788330192.289978:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788330192.289981:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330192.290380:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792382720:12345-0@lo:400:kworker.0 Request processed in 967us (3900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330192.290387:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788330192.290471:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792382720:0@lo:400:kworker.0 00000100:00100000:2.0:1788330192.290712:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792383232:12345-0@lo:400:kworker.0 Request processed in 1758us (4027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330192.290721:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788330192.290808:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792382208:12345-0@lo:400:kworker.0 Request processed in 1973us (4395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330192.290816:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00010000:00080000:0.0:1788330192.291221:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffd6b800 x1875199792383232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330192.291233:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792383232:0@lo:400:kworker.0 00000100:00100000:0.0:1788330192.291329:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792382208:0@lo:400:kworker.0 00000100:00100000:1.0:1788330192.628237:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330192.628340:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330192.635959:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330192.635994:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330192.638796:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766069888 00000100:00100000:2.0:1788330192.638808:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766069888 00000100:00100000:2.0:1788330192.638882:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766070144 00000100:00100000:2.0:1788330192.638886:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766070144 00000100:00100000:2.0:1788330192.638918:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 297 00000100:00100000:2.0:1788330192.638928:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766069888:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330192.639016:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9759f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766069888:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 90us (10789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330192.639024:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 297 00000100:00100000:2.0:1788330192.639044:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 298 00000100:00100000:2.0:1788330192.639051:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766070144:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330192.639075:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9759880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766070144:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 26us (10735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330192.639081:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 298 00000100:00080000:2.0:1788330192.639102:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330192.639140:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766069760 00000100:00100000:2.0:1788330192.639145:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766069760 00000100:00100000:2.0:1788330192.639194:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 383 00000100:00100000:2.0:1788330192.639201:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2413:x1875199766069760:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330192.639227:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2413:x1875199766069760:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 27us (3281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330192.639234:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 383 00000100:00100000:1.0:1788330192.645788:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330192.651714:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766070016 00000100:00100000:0.0:1788330192.651731:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766070016 00000100:00100000:0.0:1788330192.651806:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766070272 00000100:00100000:0.0:1788330192.651810:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766070272 00000100:00100000:0.0:1788330192.651841:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 299 00000100:00100000:0.0:1788330192.651852:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec975b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766070016:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330192.651949:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec975b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766070016:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 98us (15953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330192.651980:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 299 00000100:00100000:0.0:1788330192.652001:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 300 00000100:00100000:0.0:1788330192.652009:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766070272:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330192.652037:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9758e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766070272:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 29us (6259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330192.652043:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 300 00000100:00080000:0.0:1788330192.652064:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788330192.795523:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788330193.714887:0:14073:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 02:23:11 (1788330191) 00010000:00010000:0.0:1788330193.823660:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330194.331780:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330194.331808:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792383872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330194.331912:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330194.333527:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792383872 00000100:00100000:1.0:1788330194.333539:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792383872 00000100:00100000:1.0:1788330194.333605:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788330194.333618:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792383872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330194.333655:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330194.333730:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792383872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (1818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330194.333737:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788330194.333767:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec975b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792384000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788330194.333804:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330194.333863:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792383872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330194.333898:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792384000 00000100:00100000:1.0:1788330194.333902:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792384000 00000100:00100000:1.0:1788330194.333928:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788330194.333934:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792384000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788330194.333946:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330194.333976:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792384000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330194.333982:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788330194.334010:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec975b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792384000:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788330194.334042:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330194.335991:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330194.336015:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792384128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330194.336087:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330194.336387:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792384128 00000100:00100000:0.0:1788330194.336398:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792384128 00000100:00100000:0.0:1788330194.336567:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788330194.336577:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec975b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792384128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330194.336608:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788330194.336685:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec975b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792384128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330194.336695:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788330194.336784:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792384128:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788330194.852633:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330195.851297:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330195.851471:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766070400 00000100:00100000:0.0:1788330195.851483:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766070400 00000100:00100000:0.0:1788330195.851571:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 40 00000100:00100000:0.0:1788330195.851582:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:11095:x1875199766070400:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330195.851602:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330195.851627:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd11a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105df5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330195.851698:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd11ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330195.851730:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd11ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330195.851756:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd11ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330195.851809:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788330195.851814:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788330195.851851:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd11ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330195.851878:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd11a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105df5 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330195.851897:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd11ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105df5 expref: 6 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330195.851906:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eec507af00) 00010000:00010000:0.0:1788330195.851908:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788330195.851912:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327000, rc 0) 00000100:00100000:0.0:1788330195.851965:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:11095:x1875199766070400:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 386us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330195.851973:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 40 00000100:00080000:2.0:1788330195.852657:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330195.865830:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330195.865963:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766070528 00000100:00100000:2.0:1788330195.865974:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766070528 00000100:00100000:2.0:1788330195.866055:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 41 00000100:00100000:2.0:1788330195.866068:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:11096:x1875199766070528:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330195.866101:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330195.866123:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd11b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105dfc expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866405:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd11bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866422:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd11bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866437:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd11bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866453:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd11c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866460:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd11c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866467:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd11c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866543:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b600/0x8475908e9fd11c9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866551:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b600/0x8475908e9fd11c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866583:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b600/0x8475908e9fd11c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330195.866628:0:12916:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788330195.866632:0:12916:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330195.866660:0:12916:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b600/0x8475908e9fd11c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866671:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd11bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866678:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd11bb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866685:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd11bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866690:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765aa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330195.866696:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd11bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866704:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd11bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866718:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eec507af00) 00010000:00010000:2.0:1788330195.866721:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330195.866728:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd11bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866735:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd11bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866762:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd11c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866769:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd11c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866775:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd11c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866781:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765a000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330195.866785:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd11c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866791:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd11c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866799:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99edc65db700) 00010000:00010000:2.0:1788330195.866802:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330195.866805:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd11c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866811:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd11c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866854:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd11b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105dfc expref: 8 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866868:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b600/0x8475908e9fd11c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105dfc expref: 7 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.866887:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99edc65db300) 00010000:00010000:2.0:1788330195.866889:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330195.866892:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99edc765b600, rc 0) 00000100:00100000:2.0:1788330195.866982:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:11096:x1875199766070528:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 916us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330195.866991:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 41 00000100:00100000:1.0:1788330195.868599:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330195.868621:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec975a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792384256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330195.868715:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330195.868792:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792384256 00000100:00100000:1.0:1788330195.868801:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792384256 00000100:00100000:1.0:1788330195.868860:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788330195.868873:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9779880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792384256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788330195.868906:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330195.868952:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9779880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792384256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330195.868960:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1788330195.868984:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788330195.869012:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec975a300 x1875199792384256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330195.869033:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec975a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792384256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330195.870531:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792384384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330195.870601:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330195.870734:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792384384 00000100:00100000:2.0:1788330195.870742:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792384384 00000100:00100000:2.0:1788330195.870802:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788330195.870812:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792384384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330195.870833:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330195.870880:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792384384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330195.870887:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:2.0:1788330195.870926:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffd6a300 x1875199792384384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330195.870945:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792384384:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788330195.871089:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788330195.871518:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330195.871610:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330195.871679:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766070656 00000100:00100000:2.0:1788330195.871685:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766070656 00000100:00100000:2.0:1788330195.871726:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:2.0:1788330195.871735:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:11096:x1875199766070656:12345-192.168.202.50@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788330195.871804:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:11096:x1875199766070656:12345-192.168.202.50@tcp:900:lhsmtool_posix.0 Request processed in 69us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330195.871810:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:3.0:1788330195.874586:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330195.874666:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766070912 00000100:00100000:1.0:1788330195.874676:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766070912 00000100:00100000:1.0:1788330195.874793:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:1.0:1788330195.874804:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:11096:x1875199766070912:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330195.874826:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330195.874845:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd11d0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e03 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.874930:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd11d7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.874944:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd11d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.874956:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd11d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.874970:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd11de lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.874977:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd11de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.874983:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd11de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.875081:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79000/0x8475908e9fd11e5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.875088:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79000/0x8475908e9fd11e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.875095:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79000/0x8475908e9fd11e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330195.875115:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788330195.875260:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd11d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.875268:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd11d7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.875276:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd11d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.875281:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330195.875286:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd11d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.875294:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd11d7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.875306:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99edc65db300) 00010000:00010000:1.0:1788330195.875309:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330195.875313:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd11d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.875320:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd11d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.875348:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd11de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.875354:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd11de lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.875369:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd11de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.875375:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330195.875378:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd11de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.875383:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd11de lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.875391:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99eec9216800) 00010000:00010000:1.0:1788330195.875393:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330195.875396:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd11de lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.875401:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd11de lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.876248:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd11d0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e03 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.876266:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79000/0x8475908e9fd11e5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e03 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330195.876275:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99eec9216d00) 00010000:00010000:1.0:1788330195.876278:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330195.876281:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79000, rc 0) 00000100:00100000:1.0:1788330195.876369:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:11096:x1875199766070912:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 1567us (1794us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788330195.876386:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:1.0:1788330195.893821:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330195.893926:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766071040 00000100:00100000:3.0:1788330195.893939:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766071040 00000100:00100000:3.0:1788330195.894452:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:3.0:1788330195.894466:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:11096:x1875199766071040:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788330195.894641:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:11096:x1875199766071040:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 Request processed in 178us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330195.894650:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:2.0:1788330195.899636:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330195.899745:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766071168 00000100:00100000:0.0:1788330195.899762:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766071168 00000100:00100000:0.0:1788330195.899871:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:0.0:1788330195.899884:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:11096:x1875199766071168:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1788330195.900355:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1788330195.909483:0:7832:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 9531us 00000100:00100000:0.0:1788330195.945384:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:11096:x1875199766071168:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 Request processed in 45479us (45741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330195.945410:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 44 00000040:00080000:2.0:1788330196.446792:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788330196.447032:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788330196.891690:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330196.891716:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792384512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788330196.891805:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330196.891880:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792384512 00000100:00100000:2.0:1788330196.891888:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792384512 00000100:00100000:2.0:1788330196.891935:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788330196.891945:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792384512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788330196.891980:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788330196.892028:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792384512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330196.892035:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788330196.892097:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792384512:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788330196.892535:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330197.406344:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792384640:0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.406361:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792384768:0@lo:400:kworker.0 00000100:00100000:1.0:1788330197.410293:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792385024:0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.410450:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330197.410527:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792385280:0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.410567:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330197.410594:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792385792:0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.410614:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330197.410663:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792384768 00000100:00100000:0.0:1788330197.410671:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792384768 00000100:00100000:0.0:1788330197.410715:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792385280 00000100:00100000:0.0:1788330197.410719:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792385280 00000100:00100000:0.0:1788330197.410743:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792385792 00000100:00100000:0.0:1788330197.410746:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792385792 00000100:00100000:0.0:1788330197.410762:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788330197.410770:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792384768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.410823:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792384768:12345-0@lo:400:kworker.0 Request processed in 52us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330197.410829:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788330197.410848:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788330197.410854:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792385280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.410881:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792385280:12345-0@lo:400:kworker.0 Request processed in 27us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330197.410896:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788330197.410910:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788330197.410916:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792385792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.410943:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792385792:12345-0@lo:400:kworker.0 Request processed in 27us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330197.410949:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788330197.410996:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792384768:0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.411007:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792385280:0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.411016:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792385792:0@lo:400:kworker.0 00000100:00080000:0.0:1788330197.411098:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330197.414523:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792384896:0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.414693:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330197.414737:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792385408:0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.414765:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330197.414800:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792385920:0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.414823:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330197.414865:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792384896 00000100:00100000:0.0:1788330197.414875:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792384896 00000100:00100000:2.0:1788330197.415067:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330197.415100:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792385152:0@lo:400:kworker.0 00000100:00100000:2.0:1788330197.415124:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330197.415141:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792385664:0@lo:400:kworker.0 00000100:00100000:2.0:1788330197.415181:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330197.415200:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792386176:0@lo:400:kworker.0 00000100:00100000:2.0:1788330197.415222:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330197.415257:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792384640 00000100:00100000:2.0:1788330197.415260:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792384640 00000100:00100000:2.0:1788330197.415299:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1788330197.415320:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef40a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3646:x1875199792384640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330197.415377:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef40a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3646:x1875199792384640:12345-0@lo:400:kworker.0 Request processed in 69us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330197.415385:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788330197.416407:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788330197.416431:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792384896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.416512:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792384896:12345-0@lo:400:kworker.0 Request processed in 93us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330197.416519:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788330197.416576:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792385152 00000100:00100000:0.0:1788330197.416583:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792385152 00000100:00100000:0.0:1788330197.416607:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788330197.416614:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792385152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.416648:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792385152:12345-0@lo:400:kworker.0 Request processed in 35us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330197.416654:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788330197.416686:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792385408 00000100:00100000:0.0:1788330197.416690:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792385408 00000100:00100000:0.0:1788330197.416728:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792385920 00000100:00100000:0.0:1788330197.416731:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792385920 00000100:00100000:0.0:1788330197.416755:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788330197.416761:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792385408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.416795:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792385408:12345-0@lo:400:kworker.0 Request processed in 34us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330197.416801:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788330197.416815:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788330197.416821:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792385920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.416850:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792385920:12345-0@lo:400:kworker.0 Request processed in 29us (2025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330197.416856:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788330197.416888:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792385664 00000100:00100000:0.0:1788330197.416907:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792385664 00000100:00100000:0.0:1788330197.416934:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792386176 00000100:00100000:0.0:1788330197.416937:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792386176 00000100:00100000:0.0:1788330197.416954:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788330197.416961:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792385664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.416992:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792385664:12345-0@lo:400:kworker.0 Request processed in 32us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330197.417016:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788330197.417028:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788330197.417033:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792386176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.417074:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792386176:12345-0@lo:400:kworker.0 Request processed in 28us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330197.417080:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788330197.417132:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792384896:0@lo:400:kworker.0 00010000:00080000:0.0:1788330197.417147:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc9f480 x1875199792385408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330197.417182:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792385408:0@lo:400:kworker.0 00010000:00080000:0.0:1788330197.417195:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc9c000 x1875199792385920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330197.417202:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792385920:0@lo:400:kworker.0 00000100:00080000:0.0:1788330197.417232:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330197.417237:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788330197.417240:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788330197.418866:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330197.419377:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792385536:0@lo:400:kworker.0 00000100:00100000:1.0:1788330197.419417:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330197.419445:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792386048:0@lo:400:kworker.0 00000100:00100000:1.0:1788330197.419467:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330197.419515:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792385536 00000100:00100000:1.0:1788330197.419522:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792385536 00000100:00100000:1.0:1788330197.419651:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792386048 00000100:00100000:1.0:1788330197.419655:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792386048 00000100:00100000:1.0:1788330197.419679:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788330197.419686:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792385536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330197.419735:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792385536:12345-0@lo:400:kworker.0 Request processed in 49us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330197.419742:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788330197.419757:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788330197.419763:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792386048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330197.419789:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792386048:12345-0@lo:400:kworker.0 Request processed in 27us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330197.419795:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1788330197.419813:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788330197.419817:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788330197.419863:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc9fb80 x1875199792385536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330197.419879:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792385536:0@lo:400:kworker.0 00000100:00100000:1.0:1788330197.419890:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792386048:0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.420372:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792385024 00000100:00100000:0.0:1788330197.420378:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792385024 00000100:00100000:0.0:1788330197.420410:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788330197.420418:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792385024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.420463:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792385024:12345-0@lo:400:kworker.0 Request processed in 46us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330197.420469:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788330197.420497:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792384640:0@lo:400:kworker.0 00000100:00100000:2.0:1788330197.420511:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792385152:0@lo:400:kworker.0 00010000:00080000:2.0:1788330197.420524:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc9ea00 x1875199792385664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330197.420533:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792385664:0@lo:400:kworker.0 00000100:00100000:2.0:1788330197.420545:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792386176:0@lo:400:kworker.0 00000100:00100000:1.0:1788330197.420615:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792385024:0@lo:400:kworker.0 00000100:00100000:0.0:1788330197.734413:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330197.734521:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330197.734601:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330197.734631:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330197.734758:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766071424 00000100:00100000:1.0:1788330197.734772:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766071424 00000100:00100000:1.0:1788330197.734849:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766071680 00000100:00100000:1.0:1788330197.734852:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766071680 00000100:00100000:1.0:1788330197.734875:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 307 00000100:00100000:1.0:1788330197.734885:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:2412:x1875199766071424:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330197.734978:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:2412:x1875199766071424:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 93us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330197.734985:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 307 00000100:00100000:1.0:1788330197.735002:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 308 00000100:00100000:1.0:1788330197.735009:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2412:x1875199766071680:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330197.735035:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2412:x1875199766071680:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 26us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330197.735041:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 308 00000100:00080000:1.0:1788330197.735060:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330197.735634:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330197.735763:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766071296 00000100:00100000:0.0:1788330197.735769:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766071296 00000100:00100000:0.0:1788330197.735807:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 385 00000100:00100000:0.0:1788330197.735815:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2412:x1875199766071296:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330197.735854:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2412:x1875199766071296:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 40us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330197.735860:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 385 00000100:00100000:0.0:1788330197.735906:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766071552 00000100:00100000:0.0:1788330197.735911:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766071552 00000100:00100000:0.0:1788330197.735938:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766071808 00000100:00100000:0.0:1788330197.735941:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766071808 00000100:00100000:0.0:1788330197.735957:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 309 00000100:00100000:0.0:1788330197.735963:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766071552:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330197.735989:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766071552:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 27us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330197.735995:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 309 00000100:00100000:0.0:1788330197.736008:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 310 00000100:00100000:0.0:1788330197.736013:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2412:x1875199766071808:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330197.736063:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2412:x1875199766071808:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 49us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330197.736068:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 310 00000100:00080000:0.0:1788330197.736207:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788330197.919799:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330198.042232:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330198.042324:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766071936 00000100:00100000:1.0:1788330198.042345:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766071936 00000100:00100000:1.0:1788330198.042426:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 45 00000100:00100000:1.0:1788330198.042439:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:11139:x1875199766071936:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1788330198.042477:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330198.042529:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd11f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e0a expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042621:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd11fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042650:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd11fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042669:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd11fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042689:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1201 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042697:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1201 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042704:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1201 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042762:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd11fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042771:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd11fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042778:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd11fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042784:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330198.042790:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd11fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042810:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd11fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042826:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eec507af00) 00010000:00010000:1.0:1788330198.042830:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330198.042836:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd11fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042843:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd11fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042858:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1201 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042865:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1201 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042871:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1201 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042877:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330198.042880:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1201 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042887:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1201 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042895:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99eed0859100) 00010000:00010000:1.0:1788330198.042898:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330198.042901:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1201 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042918:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1201 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042958:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd11f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e0a expref: 10 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042971:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eec507af00) 00010000:00010000:1.0:1788330198.042973:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330198.042977:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd11f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e0a expref: 10 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.042987:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79400, rc 0) 00000100:00100000:1.0:1788330198.043070:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:11139:x1875199766071936:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 634us (851us total) trans 0 rc 301/301 00000100:00100000:1.0:1788330198.043079:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 45 00000100:00100000:0.0:1788330198.065769:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330198.065830:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766072192 00000100:00100000:0.0:1788330198.065854:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766072192 00000100:00100000:0.0:1788330198.065934:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 46 00000100:00100000:0.0:1788330198.065947:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:11139:x1875199766072192:12345-192.168.202.50@tcp:36:lfs.0 00010000:00010000:0.0:1788330198.066026:0:12916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330198.066066:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd11ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105df5 expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.066094:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eec507af00) 00010000:00010000:0.0:1788330198.066109:0:12916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330198.066245:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1208 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.066263:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1208 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.066277:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1208 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.066292:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327a00/0x8475908e9fd120f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.066300:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327a00/0x8475908e9fd120f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.066317:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327a00/0x8475908e9fd120f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.066956:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1216 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.066983:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.066992:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788330198.067011:0:12916:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b785bf43 reply state 00000000894f0b79 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.067023:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1216 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.067030:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:0.0:1788330198.067033:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788330198.067036:0:12916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788330198.067042:0:12916:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788330198.067052:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1208 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.067059:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1208 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.067066:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1208 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.067072:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330198.067078:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1208 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.067086:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1208 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.067107:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eec91de700) 00010000:00010000:0.0:1788330198.067109:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330198.067114:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1208 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.067120:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1208 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788330198.067138:0:12916:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b785bf43 reply state 00000000894f0b79 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327a00/0x8475908e9fd120f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.067147:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327a00/0x8475908e9fd120f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.067191:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99eec91de900) 00010000:00010000:0.0:1788330198.067194:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788330198.067196:0:12916:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788330198.067355:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+10:11139:x1875199766072192:12345-192.168.202.50@tcp:36:lfs.0 Request processed in 1407us (1603us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788330198.067365:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 46 00000100:00100000:3.0:1788330198.217492:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330198.217634:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766072320 00000100:00100000:2.0:1788330198.217650:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766072320 00000100:00100000:2.0:1788330198.217745:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 47 00000100:00100000:2.0:1788330198.217758:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+10:11147:x1875199766072320:12345-192.168.202.50@tcp:101:lctl.0 00010000:00010000:2.0:1788330198.217793:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330198.217825:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b800/0x8475908e9fd121d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e11 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.217929:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd1224 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.217949:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd1224 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.217964:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd1224 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330198.218054:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788330198.218058:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330198.218118:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd1224 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.218217:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b800/0x8475908e9fd121d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e11 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.218244:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd1224 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e11 expref: 11 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.218257:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95b00) 00010000:00010000:2.0:1788330198.218261:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330198.218266:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99edc765aa00, rc 0) 00000100:00100000:2.0:1788330198.218374:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+11:11147:x1875199766072320:12345-192.168.202.50@tcp:101:lctl.0 Request processed in 615us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330198.218384:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 47 00000100:00100000:0.0:1788330198.311676:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330198.315534:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766072448 00000100:00100000:2.0:1788330198.315562:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766072448 00000100:00100000:2.0:1788330198.315677:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 48 00000100:00100000:2.0:1788330198.315694:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+11:11153:x1875199766072448:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1788330198.315727:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330198.315757:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b800/0x8475908e9fd122b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e18 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.315851:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1232 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.315892:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1232 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.315908:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1232 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.315921:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1239 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.315929:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1239 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.315935:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1239 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.316045:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a800/0x8475908e9fd1240 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.316053:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a800/0x8475908e9fd1240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.316060:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a800/0x8475908e9fd1240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330198.316104:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788330198.316108:0:6522:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330198.316213:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a800/0x8475908e9fd1240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.316230:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1232 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.316249:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1232 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.316256:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1232 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.316263:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765a000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330198.316268:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1232 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.316277:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1232 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.316293:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95b00) 00010000:00010000:2.0:1788330198.316297:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330198.316312:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1232 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.316320:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1232 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.316336:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1239 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.316343:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1239 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.316349:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1239 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.316354:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765a200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330198.316363:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1239 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.316370:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1239 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.316379:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99eec91de900) 00010000:00010000:2.0:1788330198.316382:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330198.316385:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1239 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.316391:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd1239 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.316427:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b800/0x8475908e9fd122b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e18 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.316442:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a800/0x8475908e9fd1240 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e18 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.316449:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:2.0:1788330198.316451:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788330198.316454:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99edc765a800, rc 0) 00000100:00100000:2.0:1788330198.316560:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+12:11153:x1875199766072448:12345-192.168.202.50@tcp:101:bash.0 Request processed in 869us (4892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330198.316569:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 48 00000100:00100000:0.0:1788330198.323218:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330198.323371:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766072704 00000100:00100000:1.0:1788330198.323393:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766072704 00000100:00100000:1.0:1788330198.323466:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 49 00000100:00100000:1.0:1788330198.323479:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+12:11153:x1875199766072704:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:1.0:1788330198.323504:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330198.323527:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1247 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e1f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.323658:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd124e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.323675:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd124e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.323897:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd124e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.323961:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1255 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.323968:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1255 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.323975:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1255 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788330198.324859:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788330198.325034:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd125c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.325046:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd125c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.325055:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd125c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.325797:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd124e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.325808:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd124e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.325816:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd124e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.325822:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330198.325844:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd124e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.325853:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd124e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.325868:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:1.0:1788330198.325872:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330198.325877:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd124e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.325883:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd124e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788330198.325901:0:6523:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001025da45 reply state 0000000067778ad3 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1255 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.325912:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1255 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.325918:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eed0859100) 00010000:00010000:1.0:1788330198.325920:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788330198.325923:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788330198.325967:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1247 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e1f expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.325983:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd125c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e1f expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.325991:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eed0859600) 00010000:00010000:1.0:1788330198.325993:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788330198.326002:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78a00, rc 0) 00000100:00100000:1.0:1788330198.326653:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:11153:x1875199766072704:12345-192.168.202.50@tcp:101:bash.0 Request processed in 3164us (3433us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788330198.326665:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 49 00000100:00100000:1.0:1788330198.332199:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330198.332265:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766072832 00000100:00100000:0.0:1788330198.332276:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766072832 00000100:00100000:0.0:1788330198.332354:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:0.0:1788330198.332363:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2409:x1875199766072832:12345-192.168.202.50@tcp:8:bash.0 00010000:00080000:0.0:1788330198.332398:0:8440:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:0.0:1788330198.332461:0:8440:0:(genops.c:1385:class_connect()) connect: client f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3, cookie 0x8475908e9fd126a 00002000:00100000:0.0:1788330198.332489:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3/ffff99edc7c0a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788330198.332508:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788330198.332593:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788330198.332623:0:8440:0:(import.c:65:import_set_state_nolock()) ffff99edc7c0b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330198.332698:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2409:x1875199766072832:12345-192.168.202.50@tcp:8:bash.0 Request processed in 334us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330198.332706:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:0.0:1788330198.336249:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330198.337004:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766072960 00000100:00100000:1.0:1788330198.337018:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766072960 00000100:00100000:1.0:1788330198.337113:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 29 00000100:00080000:0.0:1788330198.337125:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330198.337127:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:0:x1875199766072960:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:1.0:1788330198.337180:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330198.337211:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd1271 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e26 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788330198.337240:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330198.337259:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=402s v=(0 0) 00010000:00010000:1.0:1788330198.337264:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330198.337274:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd1271 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e26 expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.337310:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd1271 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e26 expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.337325:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78200, rc 0) 00000100:00100000:1.0:1788330198.337410:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:0:x1875199766072960:12345-192.168.202.50@tcp:101:bash.0 Request processed in 287us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330198.337422:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 29 00000100:00100000:1.0:1788330198.343601:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330198.343749:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766073088 00000100:00100000:0.0:1788330198.343761:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766073088 00000100:00100000:0.0:1788330198.343824:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:0.0:1788330198.343835:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:11153:x1875199766073088:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:0.0:1788330198.343853:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330198.343873:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1278 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e2d expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.343905:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd1271 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e26 expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.343914:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330198.343918:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330198.343923:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1278 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e2d expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.343955:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd1271 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e26 expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.343981:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd1271 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e26 expref: 8 pid: 8439 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330198.343996:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8437:1875199792386304:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330198.344104:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788330198.350684:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330198.350794:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8437:1875199792386304:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330198.350833:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1278 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e2d expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.350855:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326c00, rc 0) 00000100:00100000:0.0:1788330198.350919:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:11153:x1875199766073088:12345-192.168.202.50@tcp:101:bash.0 Request processed in 7085us (7329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330198.350929:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:2.0:1788330198.351084:0:13195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766073216 00000100:00100000:2.0:1788330198.351108:0:13195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766073216 00010000:00010000:2.0:1788330198.351146:0:13195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd1271 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e26 expref: 8 pid: 8439 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330198.351248:0:13195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:2.0:1788330198.351258:0:13195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec986e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2412:x1875199766073216:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330198.351273:0:13195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330198.351296:0:13195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd1271 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e26 expref: 8 pid: 8439 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.351320:0:13195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd1271 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e26 expref: 8 pid: 8439 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.351347:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8d068c7/0x8475908e9fd1271 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e26 expref: 8 pid: 8439 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.351365:0:13195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330198.351371:0:13195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330198.351391:0:13195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1278 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e2d expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.351403:0:13195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1278 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e2d expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.351442:0:13195:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1278 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e2d expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330198.351459:0:13195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:13195:1875199792386432:192.168.202.50@tcp:105: 00000100:00100000:2.0:1788330198.351534:0:13195:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc764b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788330198.362054:0:13195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:13195:1875199792386432:192.168.202.50@tcp:105: 00010000:00010000:0.0:1788330198.362101:0:13195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330198.362218:0:13195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec986e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2412:x1875199766073216:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 10959us (11543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330198.362232:0:13195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:1.0:1788330198.365352:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330198.365491:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766073472 00000100:00100000:0.0:1788330198.365502:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766073472 00000100:00100000:0.0:1788330198.365565:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:0.0:1788330198.365576:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:11153:x1875199766073472:12345-192.168.202.50@tcp:35:bash.0 00000100:00100000:0.0:1788330198.366398:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+16:11153:x1875199766073472:12345-192.168.202.50@tcp:35:bash.0 Request processed in 819us (1060us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788330198.366427:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:1.0:1788330198.485812:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330198.485924:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766073728 00000100:00100000:0.0:1788330198.485934:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766073728 00000100:00100000:0.0:1788330198.486012:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 50 00000100:00100000:0.0:1788330198.486023:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+16:11163:x1875199766073728:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330198.486056:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330198.486078:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd127f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e34 expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330198.486220:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788330198.486530:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd127f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e34 expref: 18 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.486546:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95b00) 00010000:00010000:0.0:1788330198.486549:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330198.486556:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd127f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e34 expref: 18 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.486573:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326e00, rc 0) 00000100:00100000:0.0:1788330198.486644:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+17:11163:x1875199766073728:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 610us (829us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1788330198.486653:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 50 00000040:00080000:2.0:1788330198.495628:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788330198.496922:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788330198.497774:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330198.498004:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766073984 00000100:00100000:2.0:1788330198.498014:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766073984 00000100:00100000:2.0:1788330198.498195:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:2.0:1788330198.498206:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+17:11163:x1875199766073984:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:2.0:1788330198.498955:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:11163:x1875199766073984:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 748us (1184us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788330198.498964:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:1.0:1788330198.608599:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330198.608771:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766074112 00000100:00100000:2.0:1788330198.608784:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766074112 00000100:00100000:2.0:1788330198.608867:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:2.0:1788330198.608897:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:11169:x1875199766074112:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330198.608929:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330198.608957:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd128d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e3b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.609054:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1294 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.609073:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.609088:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330198.609142:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788330198.609146:0:6522:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330198.609236:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.609267:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd128d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e3b expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.609286:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1294 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e3b expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.609295:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:2.0:1788330198.609308:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330198.609312:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99edc765a000, rc 0) 00000100:00100000:2.0:1788330198.613825:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:11169:x1875199766074112:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 4928us (5480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330198.613843:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:1.0:1788330198.631608:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330198.631786:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766074368 00000100:00100000:0.0:1788330198.631798:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766074368 00000100:00100000:0.0:1788330198.631871:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:0.0:1788330198.631898:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:11169:x1875199766074368:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330198.631941:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330198.631964:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd129b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e42 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.632404:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd12a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.632420:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd12a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.632432:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd12a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330198.632443:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788330198.632559:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd129b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e42 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.632577:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd12a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e42 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.632585:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eed0859600) 00010000:00010000:0.0:1788330198.632588:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330198.632592:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327e00, rc 0) 00000100:00100000:0.0:1788330198.632655:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:11169:x1875199766074368:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 774us (1058us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788330198.632661:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:1.0:1788330198.637849:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330198.637896:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330198.637971:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766074624 00000100:00100000:0.0:1788330198.637981:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766074624 00000100:00100000:0.0:1788330198.638057:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:0.0:1788330198.638088:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:11169:x1875199766074624:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330198.638115:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330198.638137:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd12b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e49 expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.638290:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd12b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.638319:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd12b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.638329:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd12b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330198.638352:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788330198.638457:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd12b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e49 expref: 24 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.638484:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd12b7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e49 expref: 23 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.638494:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eed0859600) 00010000:00010000:0.0:1788330198.638497:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788330198.638501:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326e00, rc 0) 00000100:00100000:0.0:1788330198.638558:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+23:11169:x1875199766074624:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 473us (720us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788330198.638565:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:3.0:1788330198.638928:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766074752 00000100:00100000:3.0:1788330198.638935:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766074752 00000100:00100000:3.0:1788330198.638980:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:3.0:1788330198.638988:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+23:2410:x1875199766074752:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330198.638998:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330198.639013:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd12a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e42 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330198.639041:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eed0859600) 00010000:00010000:3.0:1788330198.639045:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330198.639067:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:2410:x1875199766074752:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 81us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330198.639073:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:1.0:1788330198.659734:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330198.659869:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766074880 00000100:00100000:0.0:1788330198.659882:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766074880 00000100:00100000:0.0:1788330198.659977:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:0.0:1788330198.659988:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2412:x1875199766074880:12345-192.168.202.50@tcp:1:lfs.0 00010000:00010000:0.0:1788330198.660039:0:8632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd12c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.660061:0:8632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1278 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e2d expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.660071:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330198.660076:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788330198.660082:0:8632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd12c5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.660123:0:8632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1278 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e2d expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.660137:0:8632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1278 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e2d expref: 7 pid: 8437 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330198.660557:0:8632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8632:1875199792386560:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330198.661566:0:8632:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788330198.666238:0:8632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8632:1875199792386560:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330198.666275:0:8632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd12c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330198.667755:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330198.676685:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766075008 00000100:00100000:2.0:1788330198.676702:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766075008 00002000:00100000:2.0:1788330198.676770:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff99eec9778380 x1875199766075008/t0(0) o4->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:214/0 lens 504/0 e 0 to 0 dl 1788330209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788330198.676786:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99eec9778380 with x1875199766075008 ext(0->12) 00010000:00010000:2.0:1788330198.676796:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1278 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e2d expref: 8 pid: 8437 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.676816:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1278 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e2d expref: 8 pid: 8437 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788330198.676837:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99eec9778380 00000100:00100000:2.0:1788330198.676883:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:2.0:1788330198.676914:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2413:x1875199766075008:12345-192.168.202.50@tcp:4:lfs.0 00000001:00100000:1.0:1788330198.679922:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00000100:00100000:3.0:1788330198.693729:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9778380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:2413:x1875199766075008:12345-192.168.202.50@tcp:4:lfs.0 Request processed in 16799us (25963us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788330198.693754:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 0 00002000:00100000:3.0:1788330198.693788:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff99eec9778380 x1875199766075008/t4294967300(0) o4->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:214/0 lens 504/448 e 0 to 0 dl 1788330209 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788330198.693800:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99eec9778380 with x1875199766075008 ext(0->12) 00010000:00010000:3.0:1788330198.693815:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1278 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e2d expref: 9 pid: 8437 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330198.693840:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1278 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e2d expref: 9 pid: 8437 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788330198.693850:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99eec9778380 00000100:00100000:1.0:1788330198.717461:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330198.717758:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766075136 00000100:00100000:0.0:1788330198.717792:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766075136 00010000:00010000:0.0:1788330198.717855:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1278 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e2d expref: 9 pid: 8437 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330198.717920:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:0.0:1788330198.717933:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9779f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:2412:x1875199766075136:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330198.717953:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788330198.717979:0:8454:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788330198.717983:0:8454:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788330198 00002000:00010000:0.0:1788330198.717986:0:8454:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788330198 00002000:00010000:0.0:1788330198.717988:0:8454:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788330198 00002000:00010000:0.0:1788330198.717991:0:8454:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788330198.717998:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1278 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e2d expref: 9 pid: 8437 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.718016:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1278 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e2d expref: 9 pid: 8437 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.718050:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1278 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e2d expref: 9 pid: 8437 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.718071:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788330198.718077:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788330198.718084:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd12c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.718095:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd12c5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.718144:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330198.718286:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9779f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2412:x1875199766075136:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 354us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330198.718306:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 53 00010000:00010000:1.0:1788330198.718602:0:8632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd12c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.718614:0:8632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd12c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.718642:0:8632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd12c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.718651:0:8632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd12c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.718660:0:8632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd12c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.718668:0:8632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330198.718683:0:8632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd12c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.718693:0:8632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd12c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.718709:0:8632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd12c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330198.718717:0:8632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd12c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330198.718802:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2412:x1875199766074880:12345-192.168.202.50@tcp:1:lfs.0 Request processed in 58814us (59079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330198.718812:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:1.0:1788330198.737138:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330198.737785:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766075392 00000100:00100000:0.0:1788330198.737803:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766075392 00000100:00100000:0.0:1788330198.737877:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:0.0:1788330198.737891:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec975a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:11169:x1875199766075392:12345-192.168.202.50@tcp:35:lfs.0 00000004:00010000:0.0:1788330198.737994:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd12b7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e49 expref: 22 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788330198.738754:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1788330198.738819:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788330198.739250:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1788330198.739313:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd12cc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.739780:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd125c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e1f expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.739793:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd12cc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.740077:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd125c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e1f expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.740097:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd125c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e1f expref: 26 pid: 6523 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330198.740134:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc9f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1875199792386688:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330198.740446:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788330198.754837:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330198.755044:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc9f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1875199792386688:192.168.202.50@tcp:104: 00010000:00010000:3.0:1788330198.755089:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd12cc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330198.755643:0:13195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766075520 00000100:00100000:2.0:1788330198.755654:0:13195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766075520 00010000:00010000:2.0:1788330198.755712:0:13195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd125c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e1f expref: 27 pid: 6523 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330198.755766:0:13195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 54 00000100:00100000:2.0:1788330198.755779:0:13195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+27:2412:x1875199766075520:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330198.755799:0:13195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330198.755807:0:13195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd125c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e1f expref: 27 pid: 6523 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.755821:0:13195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd125c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e1f expref: 27 pid: 6523 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.755862:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd125c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e1f expref: 27 pid: 6523 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.755882:0:13195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eed0859600) 00010000:00010000:2.0:1788330198.755888:0:13195:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd12cc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.755899:0:13195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd12cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.755908:0:13195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd12cc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.755944:0:13195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330198.756040:0:13195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+26:2412:x1875199766075520:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 262us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330198.756049:0:13195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 54 00010000:00010000:0.0:1788330198.756239:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd12cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.756248:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd12cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788330198.756420:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1788330198.756570:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1788330198.756704:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875199792386816:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788330198.756780:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330198.756828:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e780 going to sleep for 11 seconds 00000100:00100000:2.0:1788330198.757057:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792386816 00000100:00100000:2.0:1788330198.757065:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792386816 00000100:00100000:2.0:1788330198.757109:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788330198.757118:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1875199792386816:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788330198.757238:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1875199792386816:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 121us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330198.757247:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788330198.758108:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875199792386816:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788330198.758443:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1788330198.758537:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6605500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875199792386944:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788330198.758817:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330198.758941:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788330198.760541:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792386944 00000100:00100000:1.0:1788330198.760560:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792386944 00000100:00100000:1.0:1788330198.761540:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788330198.761555:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6526:x1875199792386944:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788330198.761952:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6526:x1875199792386944:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 398us (3133us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788330198.761962:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788330198.762133:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6605500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875199792386944:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788330198.762245:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1788330198.762318:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd12cc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.762409:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd12cc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.762439:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd12cc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.762446:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330198.762453:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd12cc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.762462:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd12cc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.762484:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eed0859600) 00010000:00010000:0.0:1788330198.762487:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788330198.762494:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd12cc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330198.762501:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd12cc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788330198.764523:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788330198.765511:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788330198.765535:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 402737383354ns, next at 403737378827ns, rc = 0 00000001:00080000:0.0:1788330198.765554:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1788330198.766496:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eed0859600) 00010000:00010000:0.0:1788330198.766504:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788330198.766518:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd12b7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e49 expref: 30 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330198.767566:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec975a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+29:11169:x1875199766075392:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 29666us (30436us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1788330198.768790:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 8 00000020:00080000:0.0:1788330198.768801:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788330198.778585:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330198.778762:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766075648 00000100:00100000:2.0:1788330198.778777:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766075648 00000100:00100000:2.0:1788330198.778868:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 54 00000100:00100000:2.0:1788330198.778881:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+29:11169:x1875199766075648:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330198.778918:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330198.778949:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd12d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e50 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.779028:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd12d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e50 expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.779047:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd12d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e50 expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.779075:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:2.0:1788330198.779079:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788330198.779084:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99edc765a200, rc 0) 00000100:00100000:2.0:1788330198.779198:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+30:11169:x1875199766075648:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 319us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330198.779222:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 54 00000100:00100000:1.0:1788330198.791866:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330198.792457:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766075904 00000100:00100000:2.0:1788330198.792473:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766075904 00000100:00100000:2.0:1788330198.792553:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:2.0:1788330198.792567:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9245050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+30:11169:x1875199766075904:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:2.0:1788330198.793995:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9245050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+31:11169:x1875199766075904:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 1415us (2145us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788330198.794012:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 9 00010000:00010000:3.0:1788330198.940098:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330198.980065:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330198.980237:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766076160 00000100:00100000:2.0:1788330198.980253:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766076160 00000100:00100000:2.0:1788330198.980355:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00100000:2.0:1788330198.980368:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec975a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+31:11179:x1875199766076160:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330198.980403:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330198.980435:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b800/0x8475908e9fd12da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e57 expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330198.980817:0:12916:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788330198.980978:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b800/0x8475908e9fd12da lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e57 expref: 33 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.980999:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95b00) 00010000:00010000:2.0:1788330198.981003:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788330198.981009:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b800/0x8475908e9fd12da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e57 expref: 33 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.981028:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99edc765b800, rc 0) 00000100:00100000:2.0:1788330198.981134:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec975a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+32:11179:x1875199766076160:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 768us (1084us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1788330198.981144:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00100000:1.0:1788330198.986659:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330198.986814:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766076288 00000100:00100000:2.0:1788330198.986830:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766076288 00000100:00100000:2.0:1788330198.986924:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 56 00000100:00100000:2.0:1788330198.986937:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+32:11179:x1875199766076288:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:2.0:1788330198.987055:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765be00/0x8475908e9fd12e8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987077:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765be00/0x8475908e9fd12e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987091:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765be00/0x8475908e9fd12e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987102:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b200/0x8475908e9fd12ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987109:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b200/0x8475908e9fd12ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987114:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b200/0x8475908e9fd12ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987279:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd12f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987289:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd12f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987308:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd12f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330198.987400:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd12f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987418:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765be00/0x8475908e9fd12e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987425:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765be00/0x8475908e9fd12e8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987432:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765be00/0x8475908e9fd12e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987437:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765be00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330198.987442:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765be00/0x8475908e9fd12e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987450:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765be00/0x8475908e9fd12e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987466:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:2.0:1788330198.987469:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330198.987475:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765be00/0x8475908e9fd12e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987480:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765be00/0x8475908e9fd12e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987496:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b200/0x8475908e9fd12ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987501:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b200/0x8475908e9fd12ef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987515:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b200/0x8475908e9fd12ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987520:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765b200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330198.987523:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b200/0x8475908e9fd12ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987529:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b200/0x8475908e9fd12ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987538:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eed0859100) 00010000:00010000:2.0:1788330198.987540:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330198.987543:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b200/0x8475908e9fd12ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987549:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b200/0x8475908e9fd12ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987559:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd12f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987566:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd12f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987582:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd12f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987588:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330198.987591:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd12f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987606:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd12f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987613:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:2.0:1788330198.987616:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330198.987619:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd12f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330198.987626:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd12f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330198.987734:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+32:11179:x1875199766076288:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 798us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330198.987744:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 56 00000100:00100000:1.0:1788330198.995973:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330198.996103:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766076544 00000100:00100000:0.0:1788330198.996117:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766076544 00000100:00100000:0.0:1788330198.996216:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:0.0:1788330198.996230:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+32:11179:x1875199766076544:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:0.0:1788330198.996594:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+33:11179:x1875199766076544:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 365us (635us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788330198.996603:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:1.0:1788330199.106865:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330199.107004:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766076800 00000100:00100000:0.0:1788330199.107021:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766076800 00000100:00100000:0.0:1788330199.107139:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00100000:0.0:1788330199.107186:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+33:11182:x1875199766076800:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330199.107228:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330199.107260:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd12fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e5e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107398:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1304 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107419:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1304 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107437:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1304 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107453:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd130b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107479:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd130b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107487:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd130b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107661:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd1312 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107670:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd1312 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107678:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd1312 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330199.107691:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788330199.107795:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1304 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107803:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1304 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107810:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1304 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107817:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330199.107823:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1304 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107831:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1304 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107860:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:0.0:1788330199.107863:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330199.107870:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1304 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107877:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1304 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107892:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd130b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107899:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd130b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107905:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd130b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107910:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330199.107913:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd130b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107920:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd130b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107927:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eed0859100) 00010000:00010000:0.0:1788330199.107930:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330199.107933:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd130b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107938:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd130b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.107999:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd12fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e5e expref: 36 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.108015:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd1312 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e5e expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.108023:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:0.0:1788330199.108026:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330199.108028:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327200, rc 0) 00000100:00100000:0.0:1788330199.108122:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+35:11182:x1875199766076800:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 970us (1274us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788330199.108132:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00080000:1.0:1788330199.109010:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330199.123058:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330199.123468:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766076928 00000100:00100000:2.0:1788330199.123485:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766076928 00000100:00100000:2.0:1788330199.123582:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 58 00000100:00100000:2.0:1788330199.123598:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+35:11182:x1875199766076928:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:2.0:1788330199.123700:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1320 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.123723:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1320 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.123739:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1320 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.123790:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1320 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.123815:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1320 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.123823:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1320 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.123830:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330199.123847:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1320 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.123857:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1320 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.123873:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:2.0:1788330199.123877:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788330199.123884:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1320 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.123890:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1320 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330199.123998:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+35:11182:x1875199766076928:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 402us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330199.124007:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 58 00000100:00100000:3.0:1788330199.132716:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330199.132883:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766077184 00000100:00100000:0.0:1788330199.132900:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766077184 00000100:00100000:0.0:1788330199.133002:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:0.0:1788330199.133017:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+35:11182:x1875199766077184:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:0.0:1788330199.133671:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+36:11182:x1875199766077184:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 653us (1100us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788330199.133683:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:0.0:1788330199.452379:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330199.452413:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792387200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330199.452553:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330199.452656:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792387200 00000100:00100000:0.0:1788330199.452667:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792387200 00000100:00100000:0.0:1788330199.452728:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788330199.452740:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792387200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330199.452794:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788330199.452851:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792387200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330199.452860:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788330199.452931:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792387200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330199.453339:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792387072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788330199.453386:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330199.453594:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792387072 00000100:00100000:0.0:1788330199.453601:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792387072 00000100:00100000:0.0:1788330199.453659:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788330199.453667:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792387072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788330199.453693:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330199.453734:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792387072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330199.453740:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788330199.454011:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330199.454024:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792387328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330199.454062:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330199.454102:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792387328 00000100:00100000:2.0:1788330199.454106:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792387328 00000100:00100000:2.0:1788330199.454359:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788330199.454379:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792387328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788330199.454395:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330199.454433:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792387328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330199.454441:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788330199.454628:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792387328:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788330199.455927:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330199.455994:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792387072:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788330199.529801:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330199.534267:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766077440 00000100:00100000:0.0:1788330199.534303:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766077440 00000100:00100000:0.0:1788330199.534454:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00100000:0.0:1788330199.534469:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+36:11213:x1875199766077440:12345-192.168.202.50@tcp:101:cat.0 00010000:00010000:0.0:1788330199.534505:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330199.534533:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1327 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e65 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.534701:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd132e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.534720:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd132e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.534757:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd132e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330199.534772:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788330199.535394:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1327 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e65 expref: 39 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.535418:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd132e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e65 expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.535428:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:0.0:1788330199.535431:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330199.535435:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326400, rc 0) 00000100:00100000:0.0:1788330199.535539:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+38:11213:x1875199766077440:12345-192.168.202.50@tcp:101:cat.0 Request processed in 1073us (5753us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788330199.535546:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00100000:1.0:1788330199.547520:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330199.547722:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330199.549214:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766077824 00000100:00100000:0.0:1788330199.549234:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766077824 00000100:00100000:0.0:1788330199.549348:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:0.0:1788330199.549362:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+38:2411:x1875199766077824:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330199.549382:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330199.549420:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd132e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e65 expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.549445:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:0.0:1788330199.549450:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330199.549558:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+37:2411:x1875199766077824:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 199us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330199.549579:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:2.0:1788330199.550752:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766077696 00000100:00100000:2.0:1788330199.550768:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766077696 00000100:00100000:2.0:1788330199.550844:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:2.0:1788330199.550855:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+37:11213:x1875199766077696:12345-192.168.202.50@tcp:35:cat.0 00000100:00100000:2.0:1788330199.551707:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+38:11213:x1875199766077696:12345-192.168.202.50@tcp:35:cat.0 Request processed in 847us (4197us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788330199.551719:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:1.0:1788330199.636448:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330199.637241:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766078080 00000100:00100000:2.0:1788330199.637259:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766078080 00000100:00100000:2.0:1788330199.637383:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 60 00000100:00100000:2.0:1788330199.637400:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+38:11219:x1875199766078080:12345-192.168.202.50@tcp:101:dd.0 00010000:00010000:2.0:1788330199.637436:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330199.637441:0:7832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788330199.637479:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a000/0x8475908e9fd1294 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e3b expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.637504:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:2.0:1788330199.637510:0:7832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330199.637527:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd133c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e6c expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.637986:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1343 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.638013:0:7832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd1312 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e5e expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.638025:0:7832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1343 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.638071:0:7832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd1312 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e5e expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.638088:0:7832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd1312 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e5e expref: 38 pid: 6523 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330199.640617:0:7832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7832:1875199792387456:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330199.641755:0:7832:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc764b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788330199.651082:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330199.651329:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766078208 00000100:00100000:0.0:1788330199.651344:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766078208 00010000:00010000:0.0:1788330199.651403:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd1312 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e5e expref: 39 pid: 6523 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330199.651452:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00100000:0.0:1788330199.651465:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3740000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+39:2413:x1875199766078208:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330199.651483:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330199.651492:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd1312 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e5e expref: 39 pid: 6523 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.651508:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd1312 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e5e expref: 39 pid: 6523 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.651538:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:0.0:1788330199.651544:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1343 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.651557:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1343 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.651578:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1343 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.651603:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330199.651682:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3740000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+39:2413:x1875199766078208:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 219us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330199.651704:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 55 00010000:00010000:2.0:1788330199.664140:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd1312 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e5e expref: 38 pid: 6523 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330199.664186:0:7832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7832:1875199792387456:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330199.664219:0:7832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1343 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.664230:0:7832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1343 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.664260:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1343 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330199.664327:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788330199.664556:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd133c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e6c expref: 39 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.664587:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1343 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e6c expref: 38 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.664599:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:2.0:1788330199.664602:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788330199.664606:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038e00, rc 0) 00000100:00100000:2.0:1788330199.664699:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+38:11219:x1875199766078080:12345-192.168.202.50@tcp:101:dd.0 Request processed in 27303us (28271us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788330199.664710:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 60 00000100:00100000:3.0:1788330199.668844:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330199.669058:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766078336 00000100:00100000:0.0:1788330199.669070:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766078336 00000100:00100000:0.0:1788330199.669128:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:0.0:1788330199.669139:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+38:11219:x1875199766078336:12345-192.168.202.50@tcp:101:dd.0 00010000:00010000:0.0:1788330199.669217:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330199.669238:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1351 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e73 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.669282:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1358 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.669305:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1358 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.669319:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1358 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.669463:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1351 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e73 expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.669496:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1358 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e73 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.669510:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:0.0:1788330199.669513:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788330199.669517:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326c00, rc 0) 00000100:00100000:0.0:1788330199.669875:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+39:11219:x1875199766078336:12345-192.168.202.50@tcp:101:dd.0 Request processed in 735us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330199.669898:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:3.0:1788330199.674655:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330199.674892:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766078592 00000100:00100000:0.0:1788330199.674904:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766078592 00000100:00100000:0.0:1788330199.674975:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 62 00000100:00100000:0.0:1788330199.674986:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+39:11219:x1875199766078592:12345-192.168.202.50@tcp:36:dd.0 00010000:00010000:0.0:1788330199.675372:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd135f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.675390:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd135f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.675401:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd135f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788330199.675446:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1788330199.675468:0:6524:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cd270826 reply state 00000000ed00242d transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd135f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.675482:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd135f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330199.675489:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:0.0:1788330199.675492:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788330199.675495:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788330199.675590:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+42:11219:x1875199766078592:12345-192.168.202.50@tcp:36:dd.0 Request processed in 604us (942us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1788330199.675598:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 62 00000020:00080000:0.0:1788330199.675603:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788330199.965130:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330199.984647:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330199.986178:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766078720 00000100:00100000:2.0:1788330199.986192:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766078720 00000100:00100000:2.0:1788330199.986267:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:2.0:1788330199.986277:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+42:11233:x1875199766078720:12345-192.168.202.50@tcp:101:stat.0 00010000:00010000:2.0:1788330199.986311:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330199.986333:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1366 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e7a expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.986744:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd136d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.986781:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd136d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.986794:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd136d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.986806:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd1374 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.986814:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd1374 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.986821:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd1374 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.986898:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd137b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.986975:0:7832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1343 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e6c expref: 43 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.986985:0:7832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd137b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.987026:0:7832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1343 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e6c expref: 43 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330199.987042:0:7832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1343 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e6c expref: 43 pid: 7832 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330199.987070:0:7832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7832:1875199792387584:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330199.987324:0:7832:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc764b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788330199.991732:0:7832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7832:1875199792387584:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330199.991768:0:7832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd137b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330199.993138:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330199.994859:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766078976 00000100:00100000:0.0:1788330199.994894:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766078976 00000100:00100000:0.0:1788330199.994968:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:0.0:1788330199.994976:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+44:6185:x1875199766078976:12345-192.168.202.50@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788330199.995311:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+45:6185:x1875199766078976:12345-192.168.202.50@tcp:35:ldlm_bl.0 Request processed in 334us (2178us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788330199.995319:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:3.0:1788330200.000683:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330200.001575:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766079104 00000100:00100000:1.0:1788330200.001595:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766079104 00010000:00010000:1.0:1788330200.001655:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1343 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e6c expref: 45 pid: 7832 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330200.001861:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 56 00000100:00100000:1.0:1788330200.001873:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+45:2413:x1875199766079104:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330200.001903:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330200.001912:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1343 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e6c expref: 45 pid: 7832 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.001927:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1343 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e6c expref: 45 pid: 7832 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.001959:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1343 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e6c expref: 45 pid: 7832 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.001979:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:1.0:1788330200.001984:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd137b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.002023:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd137b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.002032:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd137b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.002070:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330200.002140:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+44:2413:x1875199766079104:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 263us (1460us total) trans 0 rc 0/0 00010000:00010000:2.0:1788330200.002181:0:7832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd137b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330200.002193:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 56 00010000:00010000:2.0:1788330200.002195:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd137b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330200.002253:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788330200.002258:0:7832:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330200.002321:0:7832:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd137b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.002336:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd137b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.002346:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd136d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.002354:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd136d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.002361:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd136d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.002369:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330200.002392:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd136d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.002401:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd136d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.002412:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:2.0:1788330200.002416:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330200.002421:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd136d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.002427:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd136d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.002440:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd1374 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.002454:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd1374 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.002461:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd1374 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.002466:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330200.002469:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd1374 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.002475:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd1374 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.002482:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eed0859100) 00010000:00010000:2.0:1788330200.002484:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330200.002493:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd1374 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.002500:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd1374 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.002531:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1366 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e7a expref: 44 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.002546:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd137b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e7a expref: 43 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.002554:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:2.0:1788330200.002556:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330200.002558:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038a00, rc 0) 00000100:00100000:2.0:1788330200.002602:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+43:11233:x1875199766078720:12345-192.168.202.50@tcp:101:stat.0 Request processed in 16326us (17965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330200.002610:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:3.0:1788330200.132532:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330200.132653:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766079360 00000100:00100000:0.0:1788330200.132664:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766079360 00000100:00100000:0.0:1788330200.132740:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 64 00000100:00100000:0.0:1788330200.132752:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+43:11239:x1875199766079360:12345-192.168.202.50@tcp:36:truncate.0 00010000:00010000:0.0:1788330200.132814:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330200.132843:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd137b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e7a expref: 43 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.132867:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:0.0:1788330200.132871:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330200.133584:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1382 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.133599:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1382 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.133609:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1382 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788330200.133685:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1788330200.133724:0:6522:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000dc349157 reply state 00000000bac9fa62 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1382 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.133749:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1382 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.133757:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:0.0:1788330200.133759:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788330200.133763:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788330200.134047:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+45:11239:x1875199766079360:12345-192.168.202.50@tcp:36:truncate.0 Request processed in 1296us (1523us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788330200.134054:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 64 00000020:00080000:0.0:1788330200.134059:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788330200.404019:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330200.404211:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766079488 00000100:00100000:0.0:1788330200.404222:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766079488 00000100:00100000:0.0:1788330200.404298:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 65 00000100:00100000:0.0:1788330200.404311:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+45:11253:x1875199766079488:12345-192.168.202.50@tcp:101:stat.0 00010000:00010000:0.0:1788330200.404352:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330200.404374:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1389 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e81 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404448:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1390 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404464:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1390 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404478:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1390 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404491:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1397 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404520:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1397 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404527:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1397 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404613:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd139e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404623:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd139e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404631:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd139e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330200.404674:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788330200.404679:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788330200.404717:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd139e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404732:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd139e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404740:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1390 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404747:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1390 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404753:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1390 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404768:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330200.404773:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1390 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404781:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1390 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404796:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:0.0:1788330200.404799:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330200.404804:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1390 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404810:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1390 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404827:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1397 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404833:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1397 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404839:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1397 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404844:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330200.404847:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1397 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404854:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1397 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404874:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eed0859100) 00010000:00010000:0.0:1788330200.404876:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330200.404879:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1397 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404884:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1397 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404912:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1389 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e81 expref: 47 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404926:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd139e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e81 expref: 46 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.404934:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:0.0:1788330200.404936:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330200.404938:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326a00, rc 0) 00000100:00100000:0.0:1788330200.405006:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+46:11253:x1875199766079488:12345-192.168.202.50@tcp:101:stat.0 Request processed in 697us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330200.405014:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 65 00000100:00100000:1.0:1788330200.540661:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330200.540928:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766079744 00000100:00100000:2.0:1788330200.540939:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766079744 00000100:00100000:2.0:1788330200.541093:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 66 00000100:00100000:2.0:1788330200.541103:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+46:11263:x1875199766079744:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330200.541124:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330200.541143:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd13a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e88 expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330200.541265:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788330200.541407:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd13a5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e88 expref: 48 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.541458:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95b00) 00010000:00010000:2.0:1788330200.541461:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788330200.541467:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd13a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e88 expref: 48 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.541486:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038c00, rc 0) 00000100:00100000:2.0:1788330200.541550:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+47:11263:x1875199766079744:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 448us (900us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1788330200.541555:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 66 00000100:00100000:3.0:1788330200.545347:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330200.545548:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766080000 00000100:00100000:1.0:1788330200.545568:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766080000 00000100:00100000:1.0:1788330200.545632:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:1.0:1788330200.545643:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+47:11263:x1875199766080000:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:1.0:1788330200.545886:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+48:11263:x1875199766080000:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 245us (549us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1788330200.545894:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:1.0:1788330200.653009:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330200.653190:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766080256 00000100:00100000:0.0:1788330200.653202:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766080256 00000100:00100000:0.0:1788330200.653274:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00100000:0.0:1788330200.653324:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+48:11269:x1875199766080256:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:0.0:1788330200.653356:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330200.653382:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd13b3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e8f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.653550:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd13ba lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.653661:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd139e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e81 expref: 49 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.653670:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd13ba lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.653708:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd139e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e81 expref: 49 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.653720:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd139e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e81 expref: 49 pid: 6524 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330200.653733:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792387712:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330200.653951:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330200.658254:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330200.658356:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766080384 00000100:00100000:2.0:1788330200.658370:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766080384 00010000:00010000:2.0:1788330200.658424:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd139e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e81 expref: 50 pid: 6524 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330200.658478:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00100000:2.0:1788330200.658502:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec986e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+50:2412:x1875199766080384:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330200.658521:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330200.658528:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd139e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e81 expref: 50 pid: 6524 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.658541:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd139e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e81 expref: 50 pid: 6524 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.658572:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:2.0:1788330200.658576:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd13ba lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.658602:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd13ba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.658608:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd13ba lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.658627:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330200.658958:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd139e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e81 expref: 50 pid: 6524 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330200.658986:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792387712:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330200.659010:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd13ba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.659020:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd13ba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.659038:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd13ba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330200.659057:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788330200.659246:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd13b3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e8f expref: 51 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.659261:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd13ba lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e8f expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.659269:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:0.0:1788330200.659272:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788330200.659274:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326000, rc 0) 00000100:00100000:2.0:1788330200.660885:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec986e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+50:2412:x1875199766080384:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 2386us (2631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330200.660896:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00100000:0.0:1788330200.661074:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+49:11269:x1875199766080256:12345-192.168.202.50@tcp:101:bash.0 Request processed in 7761us (8078us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788330200.661081:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00100000:3.0:1788330200.664435:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330200.664684:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766080640 00000100:00100000:1.0:1788330200.664693:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766080640 00000100:00100000:1.0:1788330200.664832:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 68 00000100:00100000:1.0:1788330200.664844:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+49:11269:x1875199766080640:12345-192.168.202.50@tcp:36:bash.0 00010000:00010000:1.0:1788330200.665216:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd13c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.665236:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd13c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.665268:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd13c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788330200.666542:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1788330200.666689:0:6523:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009b71ea8e reply state 00000000a217f3e5 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd13c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.666706:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd13c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.666713:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:1.0:1788330200.666715:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788330200.666719:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788330200.666870:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+52:11269:x1875199766080640:12345-192.168.202.50@tcp:36:bash.0 Request processed in 2023us (2442us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1788330200.666878:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 68 00000020:00080000:1.0:1788330200.666884:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788330200.674137:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330200.674412:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766080768 00000100:00100000:2.0:1788330200.674424:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766080768 00000100:00100000:2.0:1788330200.674698:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 69 00000100:00100000:2.0:1788330200.674712:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+52:11269:x1875199766080768:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1788330200.674747:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330200.674967:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd13cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e96 expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.675088:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd13d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.675105:0:7832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd13ba lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e8f expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.675112:0:7832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd13d6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.675147:0:7832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd13ba lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e8f expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.675203:0:7832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd13ba lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e8f expref: 53 pid: 6522 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330200.675218:0:7832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7832:1875199792387840:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330200.675342:0:7832:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc764b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330200.679067:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330200.679194:0:13195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766080896 00000100:00100000:1.0:1788330200.679205:0:13195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766080896 00010000:00010000:1.0:1788330200.679262:0:13195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd13ba lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e8f expref: 54 pid: 6522 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330200.679324:0:13195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 58 00000100:00100000:1.0:1788330200.679336:0:13195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+54:2412:x1875199766080896:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330200.679353:0:13195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330200.679369:0:13195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd13ba lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e8f expref: 54 pid: 6522 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.679406:0:13195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd13ba lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e8f expref: 54 pid: 6522 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.679433:0:13195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:1.0:1788330200.679440:0:13195:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd13d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.679452:0:13195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd13d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.679461:0:13195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd13d6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.679496:0:13195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330200.679564:0:13195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+54:2412:x1875199766080896:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 226us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330200.679570:0:13195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 58 00010000:00010000:0.0:1788330200.680117:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd13ba lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e8f expref: 53 pid: 6522 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330200.680134:0:7832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7832:1875199792387840:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330200.680204:0:7832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd13d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.680213:0:7832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd13d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.680219:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd13d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330200.680319:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788330200.680324:0:7832:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788330200.680352:0:7832:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd13d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.680386:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd13cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e96 expref: 53 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.680402:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd13d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e96 expref: 52 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.680410:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:0.0:1788330200.680413:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330200.680415:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039000, rc 0) 00000100:00100000:0.0:1788330200.680455:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+52:11269:x1875199766080768:12345-192.168.202.50@tcp:101:bash.0 Request processed in 5747us (6332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330200.680463:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 69 00000100:00100000:3.0:1788330200.685647:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330200.685722:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766081152 00000100:00100000:1.0:1788330200.685735:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766081152 00000100:00100000:1.0:1788330200.685863:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:1.0:1788330200.685873:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9244450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+52:11269:x1875199766081152:12345-192.168.202.50@tcp:35:bash.0 00000100:00100000:1.0:1788330200.686346:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9244450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+53:11269:x1875199766081152:12345-192.168.202.50@tcp:35:bash.0 Request processed in 471us (792us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788330200.686356:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:3.0:1788330200.835037:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330200.835209:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766081408 00000100:00100000:0.0:1788330200.835220:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766081408 00000100:00100000:0.0:1788330200.835337:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 70 00000100:00100000:0.0:1788330200.835348:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+53:11279:x1875199766081408:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330200.835373:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330200.835395:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd13dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105e9d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330200.835502:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788330200.835615:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd13dd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e9d expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.835650:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95b00) 00010000:00010000:0.0:1788330200.835653:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330200.835658:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd13dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e9d expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.835672:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326000, rc 0) 00000100:00100000:0.0:1788330200.835733:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+54:11279:x1875199766081408:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 386us (708us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1788330200.835741:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 70 00000100:00100000:2.0:1788330200.843103:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330200.843290:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766081536 00000100:00100000:1.0:1788330200.843303:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766081536 00000100:00100000:1.0:1788330200.843709:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 71 00000100:00100000:1.0:1788330200.843738:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+54:11279:x1875199766081536:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:1.0:1788330200.843830:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd13eb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.843850:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd13eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.843864:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd13eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.843876:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd13f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.843884:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd13f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.843890:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd13f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.843990:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd13f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844000:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd13f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844008:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd13f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788330200.844063:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd13f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844077:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd13eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844091:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd13eb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844097:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd13eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844102:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330200.844106:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd13eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844113:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd13eb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844124:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:1.0:1788330200.844127:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330200.844132:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd13eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844137:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd13eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844181:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd13f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844187:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd13f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844193:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd13f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844197:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330200.844206:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd13f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844213:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd13f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844221:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eed0859100) 00010000:00010000:1.0:1788330200.844224:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330200.844227:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd13f2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844233:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd13f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844243:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd13f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844250:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd13f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844255:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd13f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844260:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330200.844263:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd13f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844268:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd13f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844285:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:1.0:1788330200.844287:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330200.844297:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd13f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.844304:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd13f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330200.844406:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+54:11279:x1875199766081536:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 669us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330200.844415:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 71 00000100:00100000:3.0:1788330200.847634:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330200.847807:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766081792 00000100:00100000:2.0:1788330200.847819:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766081792 00000100:00100000:2.0:1788330200.847898:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:2.0:1788330200.847910:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+54:11279:x1875199766081792:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:2.0:1788330200.848194:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+55:11279:x1875199766081792:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 242us (529us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788330200.848203:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:3.0:1788330200.920298:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330200.921017:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766082048 00000100:00100000:0.0:1788330200.921045:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766082048 00000100:00100000:0.0:1788330200.921210:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 72 00000100:00100000:0.0:1788330200.921223:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+55:11282:x1875199766082048:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330200.921257:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330200.921293:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1400 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105ea4 expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.921424:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1407 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.921442:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1407 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.921453:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1407 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.921465:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd140e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.921547:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd140e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.921554:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd140e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.921742:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1415 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.921753:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.922258:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330200.922271:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788330200.922411:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1407 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.922419:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1407 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.922426:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1407 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.922433:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330200.922437:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1407 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.922445:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1407 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.922473:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:0.0:1788330200.922477:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330200.922483:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1407 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.922490:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1407 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.922507:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd140e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.922513:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd140e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.922519:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd140e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.922525:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330200.922527:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd140e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.922533:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd140e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.922542:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eed0859100) 00010000:00010000:0.0:1788330200.922544:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330200.922547:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd140e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.922553:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd140e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.922613:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1400 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ea4 expref: 58 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.922629:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1415 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ea4 expref: 57 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330200.922637:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:0.0:1788330200.922639:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330200.922642:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326200, rc 0) 00000100:00100000:0.0:1788330200.924372:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+57:11282:x1875199766082048:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 3138us (4071us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788330200.924386:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 72 00000001:00080000:3.0:1788330200.931702:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000004:00080000:3.0:1788330200.931772:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788330200.931805:0:6501:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99edc745e780 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788330200.931812:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99edc661b400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99edc745ec00 00000020:00080000:3.0:1788330200.931816:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99edc661b000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99edc7312000 00000100:00100000:2.0:1788330200.932129:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792387968:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788330200.932249:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330200.932382:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792387968 00000100:00100000:2.0:1788330200.932392:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792387968 00000100:00100000:2.0:1788330200.932463:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788330200.932476:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792387968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788330200.932516:0:8439:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1788330200.932563:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a97c0d6, atime: 0x6a97c0d6, ctime: 0x6a97c0d6, blocks: 0x8 00010000:00010000:2.0:1788330200.932574:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd1423 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.932621:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1788330200.932628:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330200.932637:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd1423 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.932654:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327a00/0x8475908e9fd120f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.932661:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd1423 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.932701:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd1423 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.932702:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327a00/0x8475908e9fd120f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.932734:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd1423 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330200.932758:0:8439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788330200.932808:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327a00/0x8475908e9fd120f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.932816:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330200.932822:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327a00/0x8475908e9fd120f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.932831:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327a00/0x8475908e9fd120f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.932857:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99eec91de900) 00010000:00010000:1.0:1788330200.932861:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330200.932868:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327a00/0x8475908e9fd120f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.932875:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327a00/0x8475908e9fd120f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.932925:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1216 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.932932:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1216 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.932939:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1216 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.932944:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330200.932947:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1216 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.932954:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1216 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.932962:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:1.0:1788330200.932965:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330200.932968:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1216 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.932973:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1216 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.932992:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1255 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.932998:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1255 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.933003:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1255 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.933015:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330200.933018:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1255 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.933024:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1255 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.933033:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eed0859100) 00010000:00010000:1.0:1788330200.933036:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330200.933039:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1255 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.933045:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1255 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.933063:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd135f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.933069:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd135f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.933075:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd135f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.933081:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330200.933084:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd135f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.933090:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd135f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.933111:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:1.0:1788330200.933114:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330200.933118:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd135f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.933124:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd135f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.933137:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1382 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.933143:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1382 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.933148:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1382 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788330200.933193:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788330200.933214:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330200.933218:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1382 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330200.933222:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330200.933225:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1382 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330200.933232:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd1423 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.933237:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:1.0:1788330200.933248:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330200.933253:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039c00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330200.933255:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1382 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330200.933265:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd1423 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.933268:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1382 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330200.933315:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd1423 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788330200.933585:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1788330200.933836:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:3.0:1788330200.934043:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd1423 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330200.934062:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd1423 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330200.934088:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330200.934090:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330200.934092:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330200.934456:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1875199792387968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1977us (2201us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788330200.934468:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1788330200.934550:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd13c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.934560:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd13c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.934567:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd13c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.934573:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330200.934577:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd13c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.934584:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd13c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.934599:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:1.0:1788330200.934602:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330200.934605:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd13c8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.934612:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd13c8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788330200.935050:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99eeffd68380/2, rc 0, transno 4294967302 00000100:00100000:3.0:1788330200.935062:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792387968:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788330200.935593:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330200.935646:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330200.935693:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766082176 00000100:00100000:1.0:1788330200.935714:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766082176 00000100:00100000:3.0:1788330200.935794:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766082304 00000100:00100000:3.0:1788330200.935804:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766082304 00000100:00100000:1.0:1788330200.935829:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 73 00000100:00100000:1.0:1788330200.935850:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:11282:x1875199766082176:12345-192.168.202.50@tcp:54:lfs.0 00000100:00100000:3.0:1788330200.935889:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:3.0:1788330200.935902:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:2413:x1875199766082304:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330200.935922:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330200.935941:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd142a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330200.935952:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1415 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ea4 expref: 14 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330200.935975:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:3.0:1788330200.935981:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330200.936044:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+13:2413:x1875199766082304:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 145us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330200.936053:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 5 00010000:00010000:1.0:1788330200.937142:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd142a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.937178:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd142a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.937228:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd142a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.937247:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd142a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.937258:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd142a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.937265:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330200.937271:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd142a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.937289:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd142a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.937303:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:1.0:1788330200.937306:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788330200.937311:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd142a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330200.937318:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd142a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330200.937447:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+12:11282:x1875199766082176:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 1599us (1855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330200.937472:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 73 00000100:00100000:3.0:1788330200.942915:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330200.943010:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766082560 00000100:00100000:1.0:1788330200.943038:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766082560 00000100:00100000:1.0:1788330200.943120:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:1.0:1788330200.943133:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+12:11282:x1875199766082560:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:1.0:1788330200.943761:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+13:11282:x1875199766082560:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 627us (861us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788330200.943774:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 17 00010000:00010000:2.0:1788330200.987514:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330200.987577:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330200.987613:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792388096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330200.987728:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330200.987864:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792388096 00000100:00100000:2.0:1788330200.987876:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792388096 00000100:00100000:2.0:1788330200.987952:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788330200.987964:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875199792388096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330200.988005:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788330200.988084:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875199792388096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330200.988093:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788330200.988197:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792388096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330200.991622:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330200.991656:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792388224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330200.991764:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330200.996982:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792388224 00000100:00100000:0.0:1788330200.997008:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792388224 00000100:00100000:0.0:1788330200.997146:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788330200.997222:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792388224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788330200.997258:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788330200.997395:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792388224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 178us (5630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330200.997404:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788330200.997533:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792388224:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788330200.998347:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330201.131234:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330201.131808:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766082816 00000100:00100000:1.0:1788330201.131821:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766082816 00000100:00100000:1.0:1788330201.131955:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 74 00000100:00100000:1.0:1788330201.131967:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+13:11300:x1875199766082816:12345-192.168.202.50@tcp:101:cat.0 00010000:00010000:1.0:1788330201.131996:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330201.132019:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1431 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105eab expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.132620:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1438 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.132637:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1438 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.132667:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1438 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330201.132693:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788330201.132839:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1431 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eab expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.132863:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1438 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eab expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.132873:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:1.0:1788330201.132877:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788330201.132881:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79e00, rc 0) 00000100:00100000:1.0:1788330201.137010:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:11300:x1875199766082816:12345-192.168.202.50@tcp:101:cat.0 Request processed in 5032us (6209us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1788330201.137036:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 74 00000100:00080000:3.0:1788330201.137755:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330201.201622:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330201.202129:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766082944 00000100:00100000:0.0:1788330201.202147:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766082944 00000100:00100000:0.0:1788330201.202247:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 75 00000100:00100000:0.0:1788330201.202260:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:11301:x1875199766082944:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330201.202307:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330201.202329:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1446 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105eb2 expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.202411:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd144d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.202426:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd144d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.202449:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd144d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330201.202508:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788330201.202513:0:7832:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788330201.202533:0:7832:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd144d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.202560:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1446 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eb2 expref: 17 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.202578:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd144d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eb2 expref: 16 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.202587:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:0.0:1788330201.202590:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788330201.202594:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326a00, rc 0) 00000100:00100000:0.0:1788330201.202659:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+16:11301:x1875199766082944:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 402us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330201.202665:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 75 00000100:00100000:2.0:1788330201.221059:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330201.221176:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766083328 00000100:00100000:3.0:1788330201.221188:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766083328 00000100:00100000:3.0:1788330201.221311:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:3.0:1788330201.221324:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+16:11301:x1875199766083328:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:3.0:1788330201.221658:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+17:11301:x1875199766083328:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 335us (609us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788330201.221667:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:3.0:1788330201.230601:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330201.230717:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766083456 00000100:00100000:2.0:1788330201.230730:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766083456 00000100:00100000:2.0:1788330201.230811:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:2.0:1788330201.230823:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+17:11301:x1875199766083456:12345-192.168.202.50@tcp:103:lfs.0 00010000:00010000:2.0:1788330201.230841:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788330201.230874:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd13d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e96 expref: 17 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.230900:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1438 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eab expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.230914:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a200/0x8475908e9fd12d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e50 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.230925:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:2.0:1788330201.230930:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330201.230996:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:11301:x1875199766083456:12345-192.168.202.50@tcp:103:lfs.0 Request processed in 175us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330201.231004:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:0.0:1788330201.236072:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330201.236189:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766083584 00000100:00100000:1.0:1788330201.236199:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766083584 00000100:00100000:1.0:1788330201.236265:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 76 00000100:00100000:1.0:1788330201.236286:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:11301:x1875199766083584:12345-192.168.202.50@tcp:58:lfs.0 00010000:00010000:1.0:1788330201.236458:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1454 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.236478:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1454 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.236491:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1454 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788330201.236756:0:12916:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788330201.236912:0:12916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788330201.237027:0:12916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788330201.237114:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:11301:x1875199766083584:12345-192.168.202.50@tcp:58:lfs.0 Request processed in 838us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330201.237124:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 76 00000100:00100000:3.0:1788330201.285293:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330201.285484:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766083712 00000100:00100000:1.0:1788330201.285504:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766083712 00000100:00100000:1.0:1788330201.285580:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 77 00000100:00100000:1.0:1788330201.285591:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:11303:x1875199766083712:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1788330201.285613:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330201.285637:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd145b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105eb9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.285731:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1462 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.285748:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1462 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.285760:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1462 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.285772:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd1469 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.285776:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd1469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.285799:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd1469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.285879:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1470 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.285885:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1470 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.285889:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1470 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330201.285926:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788330201.285929:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788330201.285945:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1470 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.285953:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1470 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.285959:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1462 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.285963:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1462 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.285967:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1462 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.285971:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330201.285974:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1462 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.285989:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1462 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.286003:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:1.0:1788330201.286006:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330201.286011:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1462 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.286016:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1462 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.286032:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd1469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.286038:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd1469 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.286044:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd1469 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.286049:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330201.286052:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd1469 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.286057:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd1469 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.286065:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eed0859100) 00010000:00010000:1.0:1788330201.286067:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330201.286070:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd1469 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.286092:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd1469 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.286126:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd145b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eb9 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.286135:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1470 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eb9 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.286141:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:1.0:1788330201.286143:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788330201.286145:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79600, rc 0) 00000100:00100000:1.0:1788330201.286331:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:11303:x1875199766083712:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 741us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330201.286337:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 77 00000040:00080000:2.0:1788330201.570114:0:13809:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788330201.570125:0:13809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788330201.570177:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788330201.570189:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788330201.570371:0:13809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13809:1875199792388352:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788330201.570497:0:13809:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc764b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788330201.575134:0:13809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13809:1875199792388352:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788330201.583564:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330201.583950:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766083840 00000100:00100000:2.0:1788330201.583963:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766083840 00000100:00100000:2.0:1788330201.584030:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 78 00000100:00100000:2.0:1788330201.584042:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:11314:x1875199766083840:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788330201.584079:0:6524:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788330201.584248:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:11314:x1875199766083840:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 207us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330201.584257:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 78 00000100:00100000:0.0:1788330201.598622:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330201.606118:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766083968 00000100:00100000:1.0:1788330201.606140:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766083968 00000100:00100000:1.0:1788330201.606258:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 79 00000100:00100000:1.0:1788330201.606290:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:11314:x1875199766083968:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788330201.606382:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1477 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606401:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1477 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606415:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1477 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606515:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd147e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606523:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd147e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606531:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd147e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606564:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1485 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606573:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606580:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330201.606638:0:12916:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788330201.606644:0:12916:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788330201.606662:0:12916:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606674:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1477 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606680:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1477 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606686:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1477 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606702:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330201.606707:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1477 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606716:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1477 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606730:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99eec9216d00) 00010000:00010000:1.0:1788330201.606733:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330201.606738:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1477 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606744:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1477 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606761:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd147e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606767:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd147e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606773:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd147e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606779:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330201.606782:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd147e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606789:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd147e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606808:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff99eed0859100) 00010000:00010000:1.0:1788330201.606811:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330201.606814:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd147e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606820:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd147e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606837:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606844:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1485 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606850:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1485 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606856:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330201.606859:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1485 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606865:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1485 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606872:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:1.0:1788330201.606874:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330201.606878:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1485 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.606883:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1485 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330201.607011:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:11314:x1875199766083968:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 Request processed in 722us (8398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330201.607020:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 79 00000100:00100000:0.0:1788330201.611277:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330201.612245:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766084224 00000100:00100000:1.0:1788330201.612257:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766084224 00000100:00100000:1.0:1788330201.612475:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 80 00000100:00100000:1.0:1788330201.612487:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:11314:x1875199766084224:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330201.612524:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330201.612968:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd148c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105ec0 expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.613098:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1493 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.613117:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.613129:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330201.613140:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788330201.613249:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.613261:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1493 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.613277:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1493 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.613283:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330201.613288:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1493 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.613295:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1493 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.613340:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:0.0:1788330201.613343:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788330201.613349:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1493 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.613356:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1493 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.613402:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd148c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ec0 expref: 17 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.613412:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99eec9216d00) 00010000:00010000:0.0:1788330201.613414:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330201.613418:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd148c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ec0 expref: 17 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.613427:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326000, rc 0) 00000100:00100000:0.0:1788330201.613498:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+16:11314:x1875199766084224:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 1014us (2243us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1788330201.613504:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 80 00000100:00100000:0.0:1788330201.628362:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330201.628410:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766084352 00000100:00100000:0.0:1788330201.628420:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766084352 00000100:00100000:0.0:1788330201.628493:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 81 00000100:00100000:0.0:1788330201.628505:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+16:11314:x1875199766084352:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788330201.628544:0:6522:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788330201.628664:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+16:11314:x1875199766084352:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 161us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330201.628681:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 81 00000100:00100000:0.0:1788330201.635606:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330201.635698:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766084608 00000100:00100000:2.0:1788330201.635710:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766084608 00000100:00100000:2.0:1788330201.635783:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 82 00000100:00100000:2.0:1788330201.635795:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+16:11314:x1875199766084608:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330201.635821:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330201.635824:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788330201.635858:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd144d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eb2 expref: 16 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.635878:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:2.0:1788330201.635884:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330201.635900:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd14a1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105ec7 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788330201.636613:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788330201.636779:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd14a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.636797:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd14a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.636809:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd14a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.636870:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd14a1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ec7 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.636890:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd14a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ec7 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.636899:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99eecbb95a00) 00010000:00010000:2.0:1788330201.636902:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330201.636915:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039a00, rc 0) 00000100:00100000:2.0:1788330201.637059:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+17:11314:x1875199766084608:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 1264us (1462us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788330201.637069:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 82 00000100:00100000:0.0:1788330201.642602:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330201.642712:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766084864 00000100:00100000:3.0:1788330201.642724:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766084864 00000100:00100000:3.0:1788330201.642810:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 83 00000100:00100000:3.0:1788330201.642822:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+17:11314:x1875199766084864:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788330201.642889:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330201.642921:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd14a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ec7 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.642938:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99eecbb95a00) 00010000:00010000:3.0:1788330201.642948:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330201.642972:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd14b6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.642985:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd14b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.642995:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd14b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.643018:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd14bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xef55d984 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.643040:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd14bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xef55d984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.643048:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd14bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xef55d984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.643098:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd14b6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.643105:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd14b6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.643111:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd14b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.643116:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59ca000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330201.643122:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd14b6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.643130:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd14b6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.643138:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:3.0:1788330201.643142:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330201.643145:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd14b6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.643193:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd14b6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.643209:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd14bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xef55d984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.643216:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd14bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xef55d984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.643222:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd14bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xef55d984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.643228:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330201.643231:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd14bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xef55d984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.643237:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd14bd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xef55d984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.643245:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xef55d984 (ffff99eefe73f900) 00010000:00010000:3.0:1788330201.643247:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330201.643250:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd14bd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xef55d984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.643256:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd14bd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xef55d984 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330201.643369:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+16:11314:x1875199766084864:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 549us (781us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788330201.643375:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 83 00000100:00100000:3.0:1788330201.645917:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330201.646199:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766084992 00000100:00100000:1.0:1788330201.646210:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766084992 00000100:00100000:1.0:1788330201.646267:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 84 00000100:00100000:1.0:1788330201.646423:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+16:11314:x1875199766084992:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330201.646444:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330201.646472:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd14c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105ece expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.646583:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd14cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.646598:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd14cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.646611:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd14cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.646747:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd14c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ece expref: 18 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.646777:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd14cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ece expref: 17 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.646786:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99eed0859100) 00010000:00010000:1.0:1788330201.646789:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788330201.646793:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79400, rc 0) 00000100:00100000:1.0:1788330201.646881:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+17:11314:x1875199766084992:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 460us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330201.649953:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 84 00000100:00100000:1.0:1788330201.650966:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330201.651067:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766085248 00000100:00100000:0.0:1788330201.651079:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766085248 00000100:00100000:0.0:1788330201.651147:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 85 00000100:00100000:0.0:1788330201.651182:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+17:11314:x1875199766085248:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788330201.651293:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd14d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.651314:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd14d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.651328:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd14d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788330201.651548:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1788330201.651561:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 405623409352ns, next at 406623405895ns, rc = 0 00000004:00010000:0.0:1788330201.651620:0:6523:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003cfab4a2 reply state 00000000ce2312f0 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd14d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.651634:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd14d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.651641:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99eed0859100) 00010000:00010000:0.0:1788330201.651644:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788330201.651648:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788330201.651752:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:11314:x1875199766085248:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 572us (788us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788330201.651781:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 85 00000100:00100000:3.0:1788330201.653889:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330201.654108:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766085376 00000100:00100000:1.0:1788330201.654118:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766085376 00000100:00100000:2.0:1788330201.654358:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 86 00000100:00100000:2.0:1788330201.654373:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:11314:x1875199766085376:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330201.654403:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330201.654426:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd14d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105ed5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.654510:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd14d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ed5 expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.654526:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd14d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ed5 expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.654547:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99eed0859100) 00010000:00010000:2.0:1788330201.654550:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788330201.654555:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038800, rc 0) 00000100:00100000:2.0:1788330201.654617:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+20:11314:x1875199766085376:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 248us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330201.654624:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 86 00000100:00100000:3.0:1788330201.658941:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330201.659113:0:13829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766085504 00000100:00100000:1.0:1788330201.659127:0:13829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766085504 00000100:00100000:1.0:1788330201.660189:0:13829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:1.0:1788330201.660198:0:13829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2409:x1875199766085504:12345-192.168.202.50@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788330201.660233:0:13829:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp t0 exp 0000000000000000 cur 405 last 0 00000020:00000080:1.0:1788330201.660262:0:13829:0:(genops.c:1385:class_connect()) connect: client f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3, cookie 0x8475908e9fd14e0 00002000:00100000:1.0:1788330201.660283:0:13829:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3/ffff99eec865c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788330201.660306:0:13829:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788330201.660403:0:13829:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788330201.660438:0:13829:0:(import.c:65:import_set_state_nolock()) ffff99eec8659000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788330201.660522:0:13829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2409:x1875199766085504:12345-192.168.202.50@tcp:8:lhsmtool_posix.0 Request processed in 322us (1593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330201.660530:0:13829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:0.0:1788330201.676386:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330201.676523:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766085632 00000100:00100000:3.0:1788330201.676534:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766085632 00000100:00100000:3.0:1788330201.676616:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:3.0:1788330201.676627:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:0:x1875199766085632:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788330201.677176:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788330201.678526:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:3.0:1788330201.678537:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00000100:00100000:0.0:1788330201.678731:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:0:x1875199766085632:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 2099us (2349us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788330201.678742:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:3.0:1788330201.692648:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330201.693285:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766085888 00000100:00100000:0.0:1788330201.693297:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766085888 00000100:00100000:0.0:1788330201.693362:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:0.0:1788330201.693373:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+20:11314:x1875199766085888:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788330201.693649:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:11314:x1875199766085888:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 276us (1010us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1788330201.693658:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:3.0:1788330201.697773:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330201.697875:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766086144 00000100:00100000:0.0:1788330201.697886:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766086144 00000100:00100000:0.0:1788330201.697951:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 87 00000100:00100000:0.0:1788330201.697962:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:11314:x1875199766086144:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788330201.698084:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:11314:x1875199766086144:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 122us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330201.698092:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 87 00000100:00100000:0.0:1788330201.700510:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330201.700896:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766086272 00000100:00100000:2.0:1788330201.700906:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766086272 00000100:00100000:2.0:1788330201.700968:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 88 00000100:00100000:2.0:1788330201.700980:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:11314:x1875199766086272:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330201.700998:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330201.701020:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd14e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105edc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.701121:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd14ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.701136:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd14ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.701184:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd14ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330201.701249:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330201.701282:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd14ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.701326:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd14e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105edc expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.701346:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd14ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105edc expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.701356:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99eed0859100) 00010000:00010000:2.0:1788330201.701359:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788330201.701363:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039e00, rc 0) 00000100:00100000:2.0:1788330201.701430:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:11314:x1875199766086272:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 452us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330201.701436:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 88 00000100:00100000:1.0:1788330201.725568:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330201.740191:0:13409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766086400 00000100:00100000:3.0:1788330201.740207:0:13409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766086400 00000100:00100000:3.0:1788330201.740286:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 35 00000100:00100000:3.0:1788330201.740299:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766086400:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330201.740326:0:13409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330201.740352:0:13409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdd94f4a/0x8475908e9fd14f5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105ee3 expref: -99 pid: 13409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788330201.740386:0:13409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a97c0d9, blocks: 0x0 00010000:00010000:3.0:1788330201.740413:0:13409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=405s v=(0 0) 00010000:00010000:3.0:1788330201.740419:0:13409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330201.740443:0:13409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdd94f4a/0x8475908e9fd14f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ee3 expref: 6 pid: 13409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.740470:0:13409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cdd94f4a/0x8475908e9fd14f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ee3 expref: 6 pid: 13409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.740486:0:13409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59ca200, rc 0) 00000100:00100000:3.0:1788330201.740589:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2412:x1875199766086400:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 292us (15035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330201.740597:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 35 00000100:00100000:3.0:1788330201.744529:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330201.745142:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766086656 00000100:00100000:0.0:1788330201.745173:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766086656 00000100:00100000:0.0:1788330201.745229:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 89 00000100:00100000:0.0:1788330201.745238:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:11314:x1875199766086656:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788330201.745377:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:11314:x1875199766086656:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 139us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330201.745385:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 89 00000100:00100000:1.0:1788330201.754016:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330201.754096:0:13829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766086784 00000100:00100000:0.0:1788330201.754108:0:13829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766086784 00000100:00100000:0.0:1788330201.754225:0:13829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00100000:0.0:1788330201.754237:0:13829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:11314:x1875199766086784:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330201.754257:0:13829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330201.754294:0:13829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd14fc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105eea expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.754580:0:13829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cdd94f4a/0x8475908e9fd14f5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ee3 expref: 7 pid: 13409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.754591:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330201.754595:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330201.754602:0:13829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd14fc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eea expref: 7 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.754643:0:13829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cdd94f4a/0x8475908e9fd14f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ee3 expref: 7 pid: 13409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.754657:0:13829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cdd94f4a/0x8475908e9fd14f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ee3 expref: 7 pid: 13409 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330201.754674:0:13829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13829:1875199792388480:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330201.754790:0:13829:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788330201.766728:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330201.766780:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766086912 00000100:00100000:2.0:1788330201.766790:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766086912 00010000:00010000:2.0:1788330201.766840:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cdd94f4a/0x8475908e9fd14f5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ee3 expref: 8 pid: 13409 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330201.766887:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00100000:2.0:1788330201.766900:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2413:x1875199766086912:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330201.766917:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330201.766942:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cdd94f4a/0x8475908e9fd14f5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ee3 expref: 8 pid: 13409 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.766966:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cdd94f4a/0x8475908e9fd14f5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ee3 expref: 8 pid: 13409 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.766998:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330201.767003:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330201.767013:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd14fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eea expref: 8 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.767024:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd14fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eea expref: 8 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.767063:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd14fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eea expref: 8 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330201.767078:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6508:1875199792388608:192.168.202.50@tcp:105: 00000100:00100000:2.0:1788330201.767188:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc764b0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788330201.771352:0:13829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdd94f4a/0x8475908e9fd14f5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ee3 expref: 8 pid: 13409 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330201.771381:0:13829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13829:1875199792388480:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330201.771415:0:13829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd14fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eea expref: 7 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.771440:0:13829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326800, rc 0) 00000100:00100000:0.0:1788330201.771524:0:13829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:11314:x1875199766086784:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 17288us (17516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330201.771533:0:13829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00100000:3.0:1788330201.777190:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6508:1875199792388608:192.168.202.50@tcp:105: 00010000:00010000:3.0:1788330201.777223:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330201.777328:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2413:x1875199766086912:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 10429us (10613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330201.777340:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00100000:0.0:1788330201.780186:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330201.780288:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766087040 00000100:00100000:3.0:1788330201.780299:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766087040 00002000:00100000:3.0:1788330201.780359:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff99edc75fc700 x1875199766087040/t0(0) o4->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:217/0 lens 504/0 e 0 to 0 dl 1788330212 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788330201.780371:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99edc75fc700 with x1875199766087040 ext(0->8) 00002000:00010000:3.0:1788330201.780376:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99edc75fc700 00000100:00100000:3.0:1788330201.780410:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:3.0:1788330201.780420:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2413:x1875199766087040:12345-192.168.202.50@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788330201.782981:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2413:x1875199766087040:12345-192.168.202.50@tcp:4:lhsmtool_posix.0 Request processed in 2542us (2817us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788330201.783002:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 0 00002000:00100000:3.0:1788330201.783017:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff99edc75fc700 x1875199766087040/t4294967303(0) o4->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:217/0 lens 504/448 e 0 to 0 dl 1788330212 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788330201.783029:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99edc75fc700 with x1875199766087040 ext(0->8) 00002000:00010000:3.0:1788330201.783038:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99edc75fc700 00000100:00100000:1.0:1788330201.785974:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330201.786452:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766087168 00000100:00100000:1.0:1788330201.786465:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766087168 00000100:00100000:1.0:1788330201.786555:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 90 00000100:00100000:1.0:1788330201.786570:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:11314:x1875199766087168:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788330201.795188:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00010000:00010000:0.0:1788330201.795321:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd14d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.795334:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd14d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.795342:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd14d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.795349:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330201.795355:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd14d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.795363:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd14d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.795401:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99eed0859100) 00010000:00010000:0.0:1788330201.795404:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788330201.795409:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd14d2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.795416:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd14d2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788330201.795483:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788330201.795518:0:6501:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1788330201.796392:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:11314:x1875199766087168:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 Request processed in 9819us (10423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330201.796405:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 90 00000020:00080000:3.0:1788330201.796450:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1788330201.796462:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788330201.797753:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792388736:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788330201.797828:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330201.798123:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792388736 00000100:00100000:0.0:1788330201.798133:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792388736 00000100:00100000:0.0:1788330201.798388:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788330201.798399:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792388736:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788330201.799121:0:8632:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788330201.799125:0:8632:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788330201 00002000:00010000:0.0:1788330201.799127:0:8632:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788330201.799129:0:8632:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788330201 -> 1788330201 00002000:00010000:0.0:1788330201.799131:0:8632:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00080000:3.0:1788330201.799335:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330201.799708:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1875199792388736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1307us (1876us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788330201.799718:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788330201.800102:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330201.803332:0:13409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766087296 00000100:00100000:3.0:1788330201.803348:0:13409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766087296 00000100:00100000:3.0:1788330201.803412:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 38 00000100:00100000:3.0:1788330201.803424:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2410:x1875199766087296:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1788330201.806701:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99edc75ffb80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788330201.806720:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792388736:0@lo:2:osp-syn-1-0.0 00000001:00080000:1.0:1788330201.811145:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1788330201.811189:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788330201.811483:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766087296:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 Request processed in 8055us (11377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330201.811494:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 38 00000100:00100000:0.0:1788330201.821710:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330201.821789:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766087552 00000100:00100000:2.0:1788330201.821799:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766087552 00000100:00100000:2.0:1788330201.821866:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 91 00000100:00100000:2.0:1788330201.821877:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:11314:x1875199766087552:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788330201.821936:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330201.821962:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd14ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105edc expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.822004:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99eed0859100) 00010000:00010000:2.0:1788330201.822010:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330201.822042:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1503 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.822055:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1503 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.822065:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1503 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330201.822468:0:6524:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ad9db9bb reply state 000000008754f8bf transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1503 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.822483:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1503 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.822490:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99eed0859100) 00010000:00010000:2.0:1788330201.822492:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788330201.822495:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330201.822610:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:11314:x1875199766087552:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 733us (909us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1788330201.822618:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 91 00000100:00100000:0.0:1788330201.833473:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330201.833578:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766087680 00000100:00100000:2.0:1788330201.833589:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766087680 00000100:00100000:2.0:1788330201.833682:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00100000:2.0:1788330201.833694:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766087680:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788330201.833869:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788330201.833879:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788330201 -> 1788330200 00002000:00010000:2.0:1788330201.833881:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788330198 00002000:00010000:2.0:1788330201.833884:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788330201 -> 1788330200 00002000:00010000:2.0:1788330201.833886:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788330201.833998:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2410:x1875199766087680:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 297us (529us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788330201.834007:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00100000:1.0:1788330201.838762:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330201.838898:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766087936 00000100:00100000:0.0:1788330201.838908:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766087936 00000100:00100000:0.0:1788330201.839004:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 92 00000100:00100000:0.0:1788330201.839014:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:11314:x1875199766087936:12345-192.168.202.50@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788330201.839102:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd150a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.839120:0:12916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd14cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ece expref: 15 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.839130:0:12916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd150a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.839220:0:12916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd14cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ece expref: 15 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.839235:0:12916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd14cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ece expref: 15 pid: 12916 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330201.839250:0:12916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792388864:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330201.839341:0:12916:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788330201.843737:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330201.844287:0:12916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792388864:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330201.844335:0:12916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd150a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330201.847020:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766088064 00000100:00100000:3.0:1788330201.847037:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766088064 00010000:00010000:3.0:1788330201.847106:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd14cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ece expref: 16 pid: 12916 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330201.847214:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 60 00000100:00100000:1.0:1788330201.847229:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+16:2412:x1875199766088064:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330201.847246:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330201.847255:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd14cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ece expref: 16 pid: 12916 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.847280:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd14cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ece expref: 16 pid: 12916 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.847328:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd14cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ece expref: 16 pid: 12916 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.847343:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99eed0859100) 00010000:00010000:1.0:1788330201.847348:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd150a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.847360:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd150a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.847368:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd150a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.847401:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330201.847696:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:2412:x1875199766088064:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 470us (3971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330201.847705:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 60 00010000:00010000:3.0:1788330201.847706:0:12916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd150a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.847713:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd150a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.847764:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd150a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.847773:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd150a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.847779:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd150a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.847792:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330201.847797:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd150a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.847817:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd150a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.847835:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99eed0859100) 00010000:00010000:3.0:1788330201.847838:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788330201.847842:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd150a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.847850:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd150a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330201.847911:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:11314:x1875199766087936:12345-192.168.202.50@tcp:55:lhsmtool_posix.0 Request processed in 8898us (9159us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788330201.847923:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 92 00000100:00100000:1.0:1788330201.851477:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330201.851926:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766088192 00000100:00100000:0.0:1788330201.851937:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766088192 00000100:00100000:0.0:1788330201.851998:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 40 00000100:00100000:0.0:1788330201.852009:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2413:x1875199766088192:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788330201.852056:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001dd9a1b3/0x8475908e9fd1511 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.852088:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd14fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eea expref: 7 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.852097:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330201.852101:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788330201.852106:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dd9a1b3/0x8475908e9fd1511 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.852142:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd14fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eea expref: 7 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.852180:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd14fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eea expref: 7 pid: 13829 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330201.852195:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8440:1875199792388992:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330201.852297:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788330201.860670:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330201.860767:0:13195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766088320 00000100:00100000:3.0:1788330201.860818:0:13195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766088320 00010000:00010000:3.0:1788330201.860870:0:13195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd14fc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eea expref: 8 pid: 13829 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330201.860922:0:13195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:3.0:1788330201.860934:0:13195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2413:x1875199766088320:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330201.860948:0:13195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330201.860972:0:13195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd14fc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eea expref: 8 pid: 13829 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.861017:0:13195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd14fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eea expref: 8 pid: 13829 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.861044:0:13195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788330201.861049:0:13195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788330201.861055:0:13195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001dd9a1b3/0x8475908e9fd1511 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.861067:0:13195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dd9a1b3/0x8475908e9fd1511 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.861089:0:13195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330201.861139:0:13195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2413:x1875199766088320:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 209us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330201.861146:0:13195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 61 00010000:00010000:0.0:1788330201.861414:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd14fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eea expref: 7 pid: 13829 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330201.861436:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8440:1875199792388992:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330201.861458:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001dd9a1b3/0x8475908e9fd1511 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.861468:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001dd9a1b3/0x8475908e9fd1511 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.861484:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001dd9a1b3/0x8475908e9fd1511 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.861506:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001dd9a1b3/0x8475908e9fd1511 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.861515:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001dd9a1b3/0x8475908e9fd1511 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.861523:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001dd9a1b3/0x8475908e9fd1511 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.861531:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330201.861535:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001dd9a1b3/0x8475908e9fd1511 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.861546:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001dd9a1b3/0x8475908e9fd1511 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.861561:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001dd9a1b3/0x8475908e9fd1511 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.861569:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dd9a1b3/0x8475908e9fd1511 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330201.861634:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2413:x1875199766088192:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 Request processed in 9627us (10164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330201.861643:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 40 00000100:00100000:3.0:1788330201.873946:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330201.874037:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766088576 00000100:00100000:1.0:1788330201.874049:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766088576 00000100:00100000:1.0:1788330201.874180:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 93 00000100:00100000:1.0:1788330201.874191:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:11314:x1875199766088576:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788330201.874296:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1518 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.874323:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1358 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e73 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.874353:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1518 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.874411:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1358 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e73 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.874427:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1358 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e73 expref: 14 pid: 6522 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330201.874452:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f76300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792389120:192.168.202.50@tcp:104: 00000100:00100000:1.0:1788330201.874563:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc177a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788330201.890332:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330201.890549:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766088704 00000100:00100000:0.0:1788330201.890560:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766088704 00010000:00010000:0.0:1788330201.890607:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1358 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e73 expref: 15 pid: 6522 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330201.890644:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 62 00000100:00100000:0.0:1788330201.890654:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec986f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:2412:x1875199766088704:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330201.890673:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330201.890681:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1358 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e73 expref: 15 pid: 6522 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.890696:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1358 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e73 expref: 15 pid: 6522 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.890725:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:0.0:1788330201.890731:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1518 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.890744:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1518 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.890753:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1518 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.890797:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330201.890869:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec986f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:2412:x1875199766088704:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 215us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330201.890876:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 62 00010000:00010000:3.0:1788330201.891511:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1358 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e73 expref: 14 pid: 6522 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330201.891532:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f76300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792389120:192.168.202.50@tcp:104: 00010000:00010000:3.0:1788330201.891553:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1518 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.891561:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1518 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.891579:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1518 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.891777:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd151f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.891791:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd14d9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ed5 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.891799:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd151f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.891830:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd14d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ed5 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.891845:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd14d9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ed5 expref: 14 pid: 6524 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330201.891859:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7ef2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792389248:192.168.202.50@tcp:104: 00000100:00100000:3.0:1788330201.891934:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10a5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788330201.913052:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7ef2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792389248:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330201.913086:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd151f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330201.920321:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330201.920731:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766088832 00000100:00100000:2.0:1788330201.920743:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766088832 00010000:00010000:2.0:1788330201.920793:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd14d9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ed5 expref: 15 pid: 6524 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330201.920841:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:2.0:1788330201.920853:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:2412:x1875199766088832:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330201.920870:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330201.920878:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd14d9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ed5 expref: 15 pid: 6524 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.920892:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd14d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ed5 expref: 15 pid: 6524 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.920917:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd14d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ed5 expref: 15 pid: 6524 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.920937:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99eed0859100) 00010000:00010000:2.0:1788330201.920942:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd151f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.920970:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd151f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.920978:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd151f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330201.921077:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330201.921136:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:2412:x1875199766088832:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 285us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330201.921144:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 63 00010000:00010000:0.0:1788330201.921585:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd151f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.921595:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd151f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788330201.921722:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1788330201.921852:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1788330201.921892:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1788330201.921973:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1875199792389376:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788330201.924059:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330201.924103:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330201.924372:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792389376 00000100:00100000:2.0:1788330201.924381:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792389376 00000100:00100000:2.0:1788330201.924446:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788330201.924456:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1875199792389376:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788330201.925027:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1875199792389376:12345-0@lo:1000:mdt00_000.0 Request processed in 572us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330201.925036:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788330201.925366:0:6522:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788330201.925372:0:6522:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99edc75ffb80, transno 4294967304 00000100:00100000:0.0:1788330201.925391:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1875199792389376:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788330201.925568:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1788330201.925647:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1875199792389504:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788330201.925687:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330201.925731:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665c180 going to sleep for 11 seconds 00000100:00100000:2.0:1788330201.926108:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792389504 00000100:00100000:2.0:1788330201.926116:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792389504 00000100:00100000:2.0:1788330201.926177:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788330201.926185:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1875199792389504:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788330201.926331:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6522:x1875199792389504:12345-0@lo:1000:mdt00_000.0 Request processed in 147us (644us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788330201.926336:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788330201.926785:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1875199792389504:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788330201.926829:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd151f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.926840:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd151f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.926848:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd151f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.926854:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330201.926858:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd151f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.926866:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd151f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.926883:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99eed0859100) 00010000:00010000:0.0:1788330201.926886:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788330201.926891:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd151f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.926897:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd151f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.926930:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1454 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.926935:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1454 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.926939:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1454 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.926954:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330201.926957:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1454 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.926961:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1454 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.926967:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:0.0:1788330201.926969:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788330201.926971:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1454 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.926975:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1454 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.927005:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1526 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.927016:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1470 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eb9 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.927023:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1526 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.927046:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1470 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eb9 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.927056:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1470 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eb9 expref: 17 pid: 6523 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330201.927076:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792389632:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330201.927141:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788330201.935382:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330201.935757:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792389632:192.168.202.50@tcp:104: 00010000:00010000:1.0:1788330201.935792:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1526 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330201.942206:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766088960 00000100:00100000:3.0:1788330201.942223:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766088960 00010000:00010000:3.0:1788330201.942292:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1470 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eb9 expref: 18 pid: 6523 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330201.942375:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 64 00000100:00100000:3.0:1788330201.942387:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:2413:x1875199766088960:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330201.942403:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330201.942431:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1470 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eb9 expref: 18 pid: 6523 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.942446:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1470 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eb9 expref: 18 pid: 6523 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.942471:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1470 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eb9 expref: 18 pid: 6523 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.942489:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:3.0:1788330201.942494:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1526 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.942506:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1526 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.942513:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1526 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330201.942539:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788330201.942562:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1526 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.942571:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1526 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.942583:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1526 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.942589:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1526 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.942606:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1526 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.942612:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327600 already unused, calling callback (ffffffffc1aff4f0) 00000100:00100000:3.0:1788330201.942613:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+17:2413:x1875199766088960:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 228us (7243us total) trans 0 rc 0/0 00010000:00010000:1.0:1788330201.942617:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1526 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330201.942620:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 64 00010000:00010000:1.0:1788330201.942624:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1526 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.942634:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:1.0:1788330201.942637:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330201.942641:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1526 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.942647:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1526 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.942657:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1518 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.942663:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1518 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.942669:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1518 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.942674:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330201.942677:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1518 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.942694:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1518 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.942703:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95300) 00010000:00010000:1.0:1788330201.942705:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788330201.942708:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1518 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.942714:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1518 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330201.942871:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+16:11314:x1875199766088576:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 68681us (68936us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788330201.942881:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 93 00000020:00080000:1.0:1788330201.942885:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788330201.943396:0:13809:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788330201.943401:0:13809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788330201.943420:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788330201.943444:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788330201.948321:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330201.948734:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766089216 00000100:00100000:0.0:1788330201.948747:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766089216 00000100:00100000:0.0:1788330201.948811:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:0.0:1788330201.948824:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+16:11314:x1875199766089216:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788330201.949128:0:6525:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788330201.949203:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1788330201.949243:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd152d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.949261:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd152d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.949286:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd152d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.949295:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd152d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.949312:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd152d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.949320:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd152d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330201.949346:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788330201.949474:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:11314:x1875199766089216:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 651us (1171us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788330201.949481:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 20 00000020:00080000:0.0:1788330201.950199:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788330201.950824:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330201.950835:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd152d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.950846:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327e00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330201.950851:0:10341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd152d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.950862:0:10341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd152d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.950883:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99eed0859100) 00010000:00010000:1.0:1788330201.950887:0:10341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788330201.950910:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd152d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.950916:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd152d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330201.950932:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330201.950934:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330201.950935:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330202.019443:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330202.019469:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792389760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330202.019559:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330202.019651:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792389760 00000100:00100000:3.0:1788330202.019662:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792389760 00000100:00100000:3.0:1788330202.019712:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788330202.019722:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792389760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788330202.019768:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788330202.019821:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792389760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330202.019829:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788330202.019885:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792389760:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788330202.172228:0:14222:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788330202.172236:0:14222:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788330202.172256:0:14222:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788330202.172272:0:14222:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788330202.345360:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330202.347408:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766089472 00000100:00100000:2.0:1788330202.347430:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766089472 00000100:00100000:2.0:1788330202.347561:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 94 00000100:00100000:2.0:1788330202.347574:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:11324:x1875199766089472:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330202.347609:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330202.347636:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1534 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105ef1 expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.347802:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd153b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.347822:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd153b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.347839:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd153b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330202.347852:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788330202.347993:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1534 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ef1 expref: 21 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.348014:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd153b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ef1 expref: 20 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.348024:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:2.0:1788330202.348028:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788330202.348032:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039400, rc 0) 00000100:00100000:2.0:1788330202.348132:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+20:11324:x1875199766089472:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 559us (2786us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788330202.348181:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 94 00000100:00100000:0.0:1788330202.361458:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330202.361551:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766089600 00000100:00100000:2.0:1788330202.361565:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766089600 00000100:00100000:2.0:1788330202.361645:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 95 00000100:00100000:2.0:1788330202.361659:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+20:11324:x1875199766089600:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:2.0:1788330202.361777:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1549 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.361799:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1549 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.361814:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1549 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.361833:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1550 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.361840:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1550 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.361847:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1550 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.361966:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1557 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.361974:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.361981:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330202.362057:0:12916:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362073:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1549 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362079:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1549 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362087:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1549 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362093:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330202.362098:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1549 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362106:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1549 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362120:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:2.0:1788330202.362123:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330202.362128:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1549 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362135:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1549 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362177:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1550 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362184:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1550 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362196:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1550 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362202:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330202.362205:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1550 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362212:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1550 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362220:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eecbb95400) 00010000:00010000:2.0:1788330202.362223:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330202.362226:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1550 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362231:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1550 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362249:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1557 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362255:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1557 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362271:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1557 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362278:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330202.362281:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1557 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362297:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1557 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362304:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eecbb95500) 00010000:00010000:2.0:1788330202.362306:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330202.362309:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1557 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.362314:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1557 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330202.362406:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+20:11324:x1875199766089600:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 749us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330202.362416:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 95 00000100:00100000:0.0:1788330202.452985:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330202.453057:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766089856 00000100:00100000:0.0:1788330202.453067:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766089856 00000100:00100000:0.0:1788330202.453125:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 96 00000100:00100000:0.0:1788330202.453135:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+20:11327:x1875199766089856:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330202.453177:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330202.453203:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd155e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105ef8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453296:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1565 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453311:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1565 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453324:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1565 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453339:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd156c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453347:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd156c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453353:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd156c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453509:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1573 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453517:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1573 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453524:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1573 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330202.453534:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788330202.453624:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1565 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453631:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1565 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453638:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1565 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453642:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330202.453647:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1565 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453654:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1565 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453666:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:0.0:1788330202.453670:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330202.453675:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1565 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453681:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1565 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453698:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd156c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453704:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd156c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453709:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd156c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453714:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330202.453716:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd156c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453723:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd156c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453730:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eec91de800) 00010000:00010000:0.0:1788330202.453732:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330202.453735:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd156c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453753:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd156c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453799:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd155e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ef8 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453813:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1573 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ef8 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.453831:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eec91de200) 00010000:00010000:0.0:1788330202.453834:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330202.453837:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326000, rc 0) 00000100:00100000:0.0:1788330202.453907:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:11327:x1875199766089856:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 774us (934us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788330202.453915:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 96 00000100:00100000:0.0:1788330202.458214:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330202.458450:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766089984 00000100:00100000:3.0:1788330202.458462:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766089984 00000100:00100000:3.0:1788330202.458532:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 97 00000100:00100000:3.0:1788330202.458543:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:11327:x1875199766089984:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:3.0:1788330202.458624:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1581 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.458643:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1581 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.458655:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1581 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.458693:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1581 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.458701:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1581 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.458707:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1581 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.458730:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59ca000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330202.458735:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1581 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.458816:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1581 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.458833:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eec91de200) 00010000:00010000:3.0:1788330202.458837:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788330202.458842:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1581 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.458849:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1581 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330202.459579:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:11327:x1875199766089984:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 1032us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330202.459589:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 97 00000100:00100000:3.0:1788330202.463605:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330202.464044:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766090240 00000100:00100000:1.0:1788330202.464057:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766090240 00000100:00100000:1.0:1788330202.464132:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:1.0:1788330202.464145:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9244850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:11327:x1875199766090240:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:1.0:1788330202.466505:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9244850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+23:11327:x1875199766090240:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 2353us (2901us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1788330202.466520:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:0.0:1788330202.524807:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792389888:0@lo:400:kworker.0 00000100:00100000:0.0:1788330202.524912:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330202.525018:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792389888 00000100:00100000:2.0:1788330202.525028:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792389888 00000100:00100000:2.0:1788330202.525086:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1788330202.525095:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792389888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330202.525576:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792389888:12345-0@lo:400:kworker.0 Request processed in 480us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330202.525585:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1788330202.525796:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792390272:0@lo:400:kworker.0 00000100:00100000:3.0:1788330202.525835:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330202.525866:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7ef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792390784:0@lo:400:kworker.0 00000100:00100000:3.0:1788330202.525890:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330202.525948:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792391296:0@lo:400:kworker.0 00000100:00100000:3.0:1788330202.525969:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330202.526005:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792390272 00000100:00100000:2.0:1788330202.526011:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792390272 00000100:00100000:2.0:1788330202.526045:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788330202.526051:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792390272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330202.526083:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792390272:12345-0@lo:400:kworker.0 Request processed in 33us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330202.526089:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788330202.526190:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7ef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792389888:0@lo:400:kworker.0 00000100:00100000:0.0:1788330202.526225:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792390400:0@lo:400:kworker.0 00000100:00100000:0.0:1788330202.526251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330202.526290:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792390912:0@lo:400:kworker.0 00000100:00100000:2.0:1788330202.526432:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792390400 00000100:00100000:2.0:1788330202.526437:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792390400 00000100:00100000:2.0:1788330202.526471:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788330202.526478:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792390400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330202.526518:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792390400:12345-0@lo:400:kworker.0 Request processed in 40us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330202.526524:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788330202.526833:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7ef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792390272:0@lo:400:kworker.0 00000100:00100000:3.0:1788330202.526855:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792390016:0@lo:400:kworker.0 00000100:00100000:3.0:1788330202.526888:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330202.526908:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792390528:0@lo:400:kworker.0 00000100:00100000:3.0:1788330202.526928:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330202.526945:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792391040:0@lo:400:kworker.0 00000100:00100000:3.0:1788330202.526965:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330202.526983:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788330202.526990:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792390144:0@lo:400:kworker.0 00000100:00100000:3.0:1788330202.527012:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330202.527027:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7ef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792390656:0@lo:400:kworker.0 00000100:00100000:3.0:1788330202.527047:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330202.527059:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792391168:0@lo:400:kworker.0 00000100:00100000:3.0:1788330202.527078:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330202.527109:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792390016 00000100:00100000:3.0:1788330202.527113:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792390016 00000100:00100000:3.0:1788330202.527134:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792390528 00000100:00100000:3.0:1788330202.527137:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792390528 00000100:00100000:3.0:1788330202.527178:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792391040 00000100:00100000:3.0:1788330202.527182:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792391040 00000100:00100000:3.0:1788330202.527194:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792390656 00000100:00100000:3.0:1788330202.527207:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792390656 00000100:00100000:3.0:1788330202.527222:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792391168 00000100:00100000:3.0:1788330202.527224:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792391168 00000100:00100000:3.0:1788330202.527242:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788330202.527248:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792390016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330202.527494:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792390016:12345-0@lo:400:kworker.0 Request processed in 49us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330202.527501:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788330202.527522:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788330202.527528:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792390528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330202.527556:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792390528:12345-0@lo:400:kworker.0 Request processed in 29us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330202.527561:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788330202.527571:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788330202.527577:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792391040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330202.527602:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792391040:12345-0@lo:400:kworker.0 Request processed in 25us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330202.527609:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788330202.527620:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788330202.527626:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792390656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330202.527651:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792390656:12345-0@lo:400:kworker.0 Request processed in 26us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330202.527656:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788330202.527666:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788330202.527672:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792391168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330202.527697:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792391168:12345-0@lo:400:kworker.0 Request processed in 26us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330202.527702:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788330202.527726:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792390144 00000100:00100000:3.0:1788330202.527729:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792390144 00000100:00100000:3.0:1788330202.527750:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788330202.527756:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792390144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330202.527784:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792390144:12345-0@lo:400:kworker.0 Request processed in 28us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330202.527798:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:3.0:1788330202.527815:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788330202.527820:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330202.527845:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7ef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792390144:0@lo:400:kworker.0 00010000:00080000:3.0:1788330202.527858:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7ef2d80 x1875199792390656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330202.527868:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7ef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792390656:0@lo:400:kworker.0 00010000:00080000:3.0:1788330202.527878:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7f20a80 x1875199792391168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330202.527885:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792391168:0@lo:400:kworker.0 00000100:00100000:3.0:1788330202.527895:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7ef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792390016:0@lo:400:kworker.0 00000100:00100000:3.0:1788330202.527905:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7ef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792390528:0@lo:400:kworker.0 00000100:00100000:3.0:1788330202.527915:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792391040:0@lo:400:kworker.0 00000100:00100000:2.0:1788330202.528012:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330202.528060:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792390784 00000100:00100000:1.0:1788330202.528065:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792390784 00000100:00100000:0.0:1788330202.528143:0:13409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792391296 00000100:00100000:0.0:1788330202.528165:0:13409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792391296 00000100:00100000:0.0:1788330202.528206:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788330202.528214:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792390784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330202.528268:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792390784:12345-0@lo:400:kworker.0 Request processed in 46us (2368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330202.528275:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788330202.528290:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788330202.528304:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792391296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330202.528333:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792391296:12345-0@lo:400:kworker.0 Request processed in 38us (2362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330202.528346:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788330202.528380:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7ef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792390784:0@lo:400:kworker.0 00000100:00100000:0.0:1788330202.528404:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792391296:0@lo:400:kworker.0 00000100:00080000:3.0:1788330202.528623:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330202.528628:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330202.528784:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792391424:0@lo:400:kworker.0 00000100:00100000:2.0:1788330202.528816:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330202.528852:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7ef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792390400:0@lo:400:kworker.0 00000100:00100000:0.0:1788330202.528915:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792390912 00000100:00100000:0.0:1788330202.528920:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792390912 00000100:00100000:0.0:1788330202.528960:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792391424 00000100:00100000:0.0:1788330202.528964:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792391424 00000100:00100000:0.0:1788330202.528982:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788330202.528988:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3647:x1875199792390912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330202.529023:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3647:x1875199792390912:12345-0@lo:400:kworker.0 Request processed in 35us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330202.529029:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788330202.529040:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788330202.529045:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1875199792391424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330202.529065:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1875199792391424:12345-0@lo:400:kworker.0 Request processed in 21us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330202.529071:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1788330202.529119:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330202.529137:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792390912:0@lo:400:kworker.0 00000100:00100000:2.0:1788330202.529169:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792391424:0@lo:400:kworker.0 00000100:00100000:0.0:1788330202.531826:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330202.532221:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766090496 00000100:00100000:3.0:1788330202.532230:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766090496 00000100:00100000:3.0:1788330202.532303:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 98 00000100:00100000:3.0:1788330202.532314:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+23:10853:x1875199766090496:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:3.0:1788330202.532339:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330202.532359:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1588 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105eff expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.532481:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd158f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.532493:0:12916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1573 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ef8 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.532499:0:12916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd158f lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.532526:0:12916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1573 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ef8 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.532536:0:12916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1573 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ef8 expref: 24 pid: 6522 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330202.532546:0:12916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f21180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792391552:192.168.202.50@tcp:104: 00000100:00100000:3.0:1788330202.532619:0:12916:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10a5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788330202.539841:0:12916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f21180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792391552:192.168.202.50@tcp:104: 00010000:00010000:3.0:1788330202.539884:0:12916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd158f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330202.541224:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330202.541337:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766090624 00000100:00100000:2.0:1788330202.541346:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766090624 00010000:00010000:2.0:1788330202.541403:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1573 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ef8 expref: 25 pid: 6522 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330202.541448:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 65 00000100:00100000:2.0:1788330202.541458:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+25:2413:x1875199766090624:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330202.541474:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330202.541482:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1573 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ef8 expref: 25 pid: 6522 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.541494:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1573 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ef8 expref: 25 pid: 6522 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.541522:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd1573 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ef8 expref: 25 pid: 6522 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.541538:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eec91de200) 00010000:00010000:2.0:1788330202.541544:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd158f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.541554:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd158f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.541562:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd158f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330202.541628:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330202.541708:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+24:2413:x1875199766090624:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 250us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330202.541716:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 65 00010000:00010000:3.0:1788330202.543128:0:12916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd158f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.543144:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd158f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330202.543505:0:12916:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788330202.543683:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1588 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eff expref: 25 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.543706:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd158f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eff expref: 24 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.543715:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eec91de200) 00010000:00010000:3.0:1788330202.543718:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788330202.543722:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59ca600, rc 0) 00000100:00100000:3.0:1788330202.543781:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+24:10853:x1875199766090496:12345-192.168.202.50@tcp:101:bash.0 Request processed in 11468us (11961us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1788330202.543791:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 98 00000100:00100000:0.0:1788330202.552848:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330202.552903:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766090752 00000100:00100000:3.0:1788330202.552914:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766090752 00000100:00100000:3.0:1788330202.553025:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 99 00000100:00100000:3.0:1788330202.553036:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+24:10853:x1875199766090752:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:3.0:1788330202.553061:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330202.553082:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd159d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f06 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.553114:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd15a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.553126:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd15a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.553135:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd15a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.553327:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd159d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f06 expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.553343:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd15a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f06 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.553350:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eec91de200) 00010000:00010000:3.0:1788330202.553352:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788330202.553355:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cb200, rc 0) 00000100:00100000:3.0:1788330202.553414:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+25:10853:x1875199766090752:12345-192.168.202.50@tcp:101:bash.0 Request processed in 380us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330202.553422:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 99 00000100:00100000:2.0:1788330202.556912:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330202.557081:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766091008 00000100:00100000:0.0:1788330202.557093:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766091008 00000100:00100000:0.0:1788330202.557193:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 100 00000100:00100000:0.0:1788330202.557217:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+25:10853:x1875199766091008:12345-192.168.202.50@tcp:36:bash.0 00010000:00010000:0.0:1788330202.557470:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd15ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.557496:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd15ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.557505:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd15ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788330202.557539:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1788330202.557557:0:6522:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007f198d08 reply state 0000000035bc78f5 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd15ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.557566:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd15ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.557571:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eec91de200) 00010000:00010000:0.0:1788330202.557574:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788330202.557576:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788330202.557601:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1788330202.557686:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+29:10853:x1875199766091008:12345-192.168.202.50@tcp:36:bash.0 Request processed in 473us (787us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788330202.557692:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 100 00000020:00080000:0.0:1788330202.557696:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788330202.560937:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330202.561254:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766091136 00000100:00100000:3.0:1788330202.561275:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766091136 00000100:00100000:3.0:1788330202.561345:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 101 00000100:00100000:3.0:1788330202.561355:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+29:10853:x1875199766091136:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:3.0:1788330202.561678:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330202.561705:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd15b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f0d expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.561782:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd15b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f0d expref: 30 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.561797:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd15b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f0d expref: 30 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.561836:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eec91de200) 00010000:00010000:3.0:1788330202.561839:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788330202.561843:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59ca000, rc 0) 00000100:00100000:3.0:1788330202.561913:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+30:10853:x1875199766091136:12345-192.168.202.50@tcp:101:bash.0 Request processed in 559us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330202.561920:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 101 00000100:00100000:2.0:1788330202.569359:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330202.571738:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766091264 00000100:00100000:0.0:1788330202.571763:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766091264 00000100:00100000:0.0:1788330202.571863:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 41 00000100:00100000:0.0:1788330202.571881:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefea09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:10853:x1875199766091264:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:0.0:1788330202.571903:0:8632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330202.571927:0:8632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd15b9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f14 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788330202.571989:0:8632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a97c0d8, atime: 0x6a97c0d6, ctime: 0x6a97c0d8, blocks: 0x8 00010000:00010000:0.0:1788330202.572014:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=406s v=(0 0) 00010000:00010000:0.0:1788330202.572020:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330202.572030:0:8632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd15b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f14 expref: 7 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.572051:0:8632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd15b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f14 expref: 7 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.572066:0:8632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326800, rc 0) 00000100:00100000:0.0:1788330202.572135:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefea09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:10853:x1875199766091264:12345-192.168.202.50@tcp:101:bash.0 Request processed in 263us (2790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330202.572143:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 41 00000100:00100000:2.0:1788330202.582627:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330202.583049:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766091392 00000100:00100000:3.0:1788330202.583060:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766091392 00002000:00010000:3.0:1788330202.583108:0:8443:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1788330202.583113:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99eeffd6b100 with x1875199766091392 ext(0->18446744073709551615) 00002000:00010000:3.0:1788330202.583127:0:8443:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99eeffd6b100. 00000100:00100000:3.0:1788330202.583219:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:3.0:1788330202.583230:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2410:x1875199766091392:12345-192.168.202.50@tcp:10:bash.0 00002000:00010000:3.0:1788330202.584719:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788330202.584728:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788330200 -> 1788330202 00002000:00010000:3.0:1788330202.584731:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788330198 -> 1788330198 00002000:00010000:3.0:1788330202.584733:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788330200 -> 1788330202 00002000:00010000:3.0:1788330202.584735:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1788330202.584818:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2410:x1875199766091392:12345-192.168.202.50@tcp:10:bash.0 Request processed in 1585us (2197us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788330202.584827:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 1 00002000:00010000:3.0:1788330202.584832:0:8443:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1788330202.584835:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99eeffd6b100 with x1875199766091392 ext(0->18446744073709551615) 00002000:00010000:3.0:1788330202.584842:0:8443:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99eeffd6b100. 00000100:00100000:1.0:1788330202.714872:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330202.720072:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766091520 00000100:00100000:3.0:1788330202.720094:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766091520 00000100:00100000:3.0:1788330202.720912:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 102 00000100:00100000:3.0:1788330202.720939:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+30:11341:x1875199766091520:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:3.0:1788330202.721032:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd15c0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721052:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd15c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721065:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd15c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721081:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd15c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721088:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd15c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721095:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd15c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721205:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721215:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721221:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330202.721279:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721319:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd15c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721326:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd15c0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721333:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd15c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721339:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330202.721345:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd15c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721354:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd15c0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721367:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:3.0:1788330202.721369:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330202.721374:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd15c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721379:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd15c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721395:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd15c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721402:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd15c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721407:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd15c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721418:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59caa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330202.721432:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd15c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721437:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd15c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721445:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eefe73f100) 00010000:00010000:3.0:1788330202.721447:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330202.721450:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd15c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721455:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd15c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721471:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721476:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721481:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721485:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330202.721487:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721493:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721510:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eec91de200) 00010000:00010000:3.0:1788330202.721512:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330202.721515:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.721520:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330202.721614:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+30:11341:x1875199766091520:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 689us (6757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330202.721631:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 102 00000100:00100000:2.0:1788330202.819717:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330202.819831:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766091776 00000100:00100000:0.0:1788330202.819843:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766091776 00000100:00100000:0.0:1788330202.819910:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 103 00000100:00100000:0.0:1788330202.819921:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+30:11344:x1875199766091776:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330202.819944:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330202.820033:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd15d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f1b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.820122:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd15dc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.820140:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd15dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.820380:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd15dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830240:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd15e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830279:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd15e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830294:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd15e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830436:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd15ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830446:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd15ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830472:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd15ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330202.830486:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788330202.830601:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd15dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830610:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd15dc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830627:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd15dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830634:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330202.830638:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd15dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830646:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd15dc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830660:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:1.0:1788330202.830663:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330202.830668:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd15dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830674:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd15dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830691:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd15e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830698:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd15e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830711:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd15e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830717:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330202.830720:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd15e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830727:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd15e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830735:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99edc75acb00) 00010000:00010000:1.0:1788330202.830737:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330202.830740:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd15e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830746:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd15e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830805:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd15d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f1b expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830820:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd15ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f1b expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330202.830827:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eec91de200) 00010000:00010000:1.0:1788330202.830830:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788330202.830832:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79400, rc 0) 00000100:00100000:1.0:1788330202.830913:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+32:11344:x1875199766091776:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 10992us (11210us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788330202.830930:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 103 00000100:00100000:2.0:1788330202.845061:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330202.845709:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766091904 00000100:00100000:3.0:1788330202.845734:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766091904 00000100:00100000:3.0:1788330202.845850:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 104 00000100:00100000:3.0:1788330202.845866:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+32:11344:x1875199766091904:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:3.0:1788330202.845988:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.846012:0:12916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd158f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eff expref: 32 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.846024:0:12916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15f8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.846080:0:12916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd158f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eff expref: 32 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.846097:0:12916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd158f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eff expref: 32 pid: 12916 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330202.846133:0:12916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f21180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792391680:192.168.202.50@tcp:104: 00000100:00100000:3.0:1788330202.846844:0:12916:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10a53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330202.863503:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330202.863829:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330202.863865:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330202.863893:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330202.863918:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330202.863950:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766092544 00000100:00100000:2.0:1788330202.863977:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766092544 00000100:00100000:2.0:1788330202.864074:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766092160 00000100:00100000:2.0:1788330202.864078:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766092160 00000100:00100000:2.0:1788330202.864116:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766092416 00000100:00100000:2.0:1788330202.864119:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766092416 00000100:00100000:2.0:1788330202.864140:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 317 00000100:00100000:2.0:1788330202.864184:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2412:x1875199766092544:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330202.864316:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2412:x1875199766092544:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 167us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330202.864325:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 317 00000100:00100000:2.0:1788330202.865550:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 318 00000100:00100000:2.0:1788330202.865573:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766092160:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330202.865785:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766092160:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 222us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330202.865794:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 318 00000100:00100000:2.0:1788330202.865815:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 319 00000100:00100000:2.0:1788330202.865824:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2412:x1875199766092416:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330202.865855:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2412:x1875199766092416:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 33us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330202.865862:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 319 00000100:00080000:2.0:1788330202.865893:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788330202.865900:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788330202.869278:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766092032 00000100:00100000:1.0:1788330202.869309:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766092032 00000100:00100000:1.0:1788330202.869389:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 387 00000100:00100000:1.0:1788330202.869403:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00beb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2412:x1875199766092032:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330202.869525:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00beb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2412:x1875199766092032:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 125us (6041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330202.869536:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 387 00000100:00100000:3.0:1788330202.876611:0:13409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766092288 00000100:00100000:3.0:1788330202.876645:0:13409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766092288 00000100:00100000:2.0:1788330202.876742:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330202.876768:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 131 00000100:00100000:2.0:1788330202.876778:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766092800 00000100:00100000:2.0:1788330202.876784:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766092800 00000100:00100000:3.0:1788330202.876785:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2412:x1875199766092288:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330202.876829:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:2.0:1788330202.876839:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+33:6185:x1875199766092800:12345-192.168.202.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788330202.876901:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2412:x1875199766092288:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 121us (13072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330202.876912:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 131 00000100:00100000:2.0:1788330202.877290:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+34:6185:x1875199766092800:12345-192.168.202.50@tcp:35:ldlm_bl.0 Request processed in 450us (556us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788330202.877302:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:0.0:1788330202.877435:0:12916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f21180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792391680:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330202.877471:0:12916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788330202.878513:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330202.884109:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330202.884339:0:13195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766092928 00000100:00100000:3.0:1788330202.884353:0:13195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766092928 00010000:00010000:3.0:1788330202.884410:0:13195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd158f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eff expref: 34 pid: 12916 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330202.884476:0:13195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 66 00000100:00100000:3.0:1788330202.884488:0:13195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+34:2412:x1875199766092928:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330202.884507:0:13195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330202.884515:0:13195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd158f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eff expref: 34 pid: 12916 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.884531:0:13195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd158f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eff expref: 34 pid: 12916 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.884562:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd158f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105eff expref: 34 pid: 12916 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.884916:0:13195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eec91de200) 00010000:00010000:3.0:1788330202.884923:0:13195:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.884936:0:13195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.884945:0:13195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15f8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330202.884992:0:13195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330202.885072:0:13195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+33:2412:x1875199766092928:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 584us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330202.885080:0:13195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 66 00010000:00010000:0.0:1788330202.885211:0:12916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.885221:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.885280:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.885287:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.885304:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.885310:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330202.885316:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.885324:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.885335:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eec91de200) 00010000:00010000:0.0:1788330202.885346:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330202.885351:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330202.885357:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd15f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330202.885426:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+32:11344:x1875199766091904:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 39555us (40370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330202.885436:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 104 00000100:00100000:3.0:1788330202.894836:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330202.895438:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766093184 00000100:00100000:2.0:1788330202.895458:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766093184 00000100:00100000:2.0:1788330202.895546:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:2.0:1788330202.895562:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+32:11344:x1875199766093184:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:2.0:1788330202.895968:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+33:11344:x1875199766093184:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 409us (1149us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788330202.895978:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 23 00010000:00010000:2.0:1788330203.035569:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330203.092960:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330203.093208:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766093440 00000100:00100000:0.0:1788330203.093226:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766093440 00000100:00100000:0.0:1788330203.093354:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 105 00000100:00100000:0.0:1788330203.093371:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+33:11356:x1875199766093440:12345-192.168.202.50@tcp:101:cat.0 00010000:00010000:0.0:1788330203.093407:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330203.093449:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd15ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f22 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.093575:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1606 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.093598:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1606 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.093859:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1606 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.093885:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd160d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.093894:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd160d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.093916:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd160d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.094066:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1614 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.094077:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1614 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.094085:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1614 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330203.094098:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00000100:00080000:1.0:1788330203.094275:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788330203.094560:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1606 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.094571:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1606 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.094688:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1606 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.094698:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330203.094703:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1606 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.094713:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1606 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.094729:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:0.0:1788330203.094733:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330203.094746:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1606 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.094753:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1606 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.094770:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd160d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.094777:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd160d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.094784:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd160d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.094788:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330203.094791:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd160d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.094797:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd160d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.094803:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eec91dec00) 00010000:00010000:0.0:1788330203.094805:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330203.094808:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd160d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.094813:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd160d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.094874:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd15ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f22 expref: 36 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.094899:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1614 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f22 expref: 35 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.094907:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eec91de200) 00010000:00010000:0.0:1788330203.094910:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330203.094912:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326200, rc 0) 00000100:00100000:0.0:1788330203.095070:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+35:11356:x1875199766093440:12345-192.168.202.50@tcp:101:cat.0 Request processed in 1703us (2123us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788330203.095080:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 105 00000100:00100000:2.0:1788330203.106455:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330203.106546:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766093696 00000100:00100000:1.0:1788330203.106561:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766093696 00000100:00100000:1.0:1788330203.106658:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:1.0:1788330203.106673:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+35:11356:x1875199766093696:12345-192.168.202.50@tcp:35:cat.0 00000100:00100000:1.0:1788330203.109194:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+36:11356:x1875199766093696:12345-192.168.202.50@tcp:35:cat.0 Request processed in 2501us (2733us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788330203.109215:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:0.0:1788330203.135983:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330203.136188:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766093952 00000100:00100000:2.0:1788330203.136202:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766093952 00000100:00100000:2.0:1788330203.136399:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 106 00000100:00100000:2.0:1788330203.136425:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+36:11357:x1875199766093952:12345-192.168.202.50@tcp:36:rm.0 00010000:00010000:2.0:1788330203.136537:0:7832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788330203.136576:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd15b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f0d expref: 36 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.136605:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1614 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f22 expref: 35 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.136621:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd15ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f1b expref: 34 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.136654:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd15a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f06 expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.136666:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eec91de200) 00010000:00010000:2.0:1788330203.136890:0:7832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330203.136925:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1622 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.136944:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1622 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.136955:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1622 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.136973:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1629 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.136980:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1629 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.136987:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1629 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.137109:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1630 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.137118:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1630 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.137125:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1630 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788330203.137956:0:7832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788330203.137971:0:7832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 407109818498ns, next at 408109815176ns, rc = 0 00010000:00010000:2.0:1788330203.138040:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1637 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.138053:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1637 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.138064:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1637 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.138072:0:7832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1637 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.138079:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1637 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.138086:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1637 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.138118:0:7832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330203.138145:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1630 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.138195:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1630 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.138202:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1630 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.138209:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330203.138224:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1630 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.138233:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1630 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.138247:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eec91de200) 00010000:00010000:2.0:1788330203.138251:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788330203.138267:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1630 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.138275:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1630 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.138300:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330203.138309:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1637 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.138315:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330203.138320:0:10341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1637 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.138326:0:10341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1637 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.138352:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eec91de200) 00010000:00010000:1.0:1788330203.138355:0:10341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788330203.138359:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1637 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.138365:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1637 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.138379:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330203.138381:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330203.138383:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330203.138966:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1622 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.138979:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1622 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.138986:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1622 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.138991:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330203.138994:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1622 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.139000:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1622 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.139014:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:2.0:1788330203.139017:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330203.139031:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1622 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.139037:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1622 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330203.139052:0:7832:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008ec0e770 reply state 0000000016046854 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1629 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.139067:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1629 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.139075:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eecbb95500) 00010000:00010000:2.0:1788330203.139077:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788330203.139080:0:7832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330203.139264:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+34:11357:x1875199766093952:12345-192.168.202.50@tcp:36:rm.0 Request processed in 2839us (3284us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788330203.139275:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 106 00000100:00100000:3.0:1788330203.228964:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330203.233024:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766094208 00000100:00100000:0.0:1788330203.233048:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766094208 00000100:00100000:1.0:1788330203.233423:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 107 00000100:00100000:1.0:1788330203.233448:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+34:11363:x1875199766094208:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:1.0:1788330203.233497:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330203.233537:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd163e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f29 expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.233826:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1645 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.233847:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1645 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.233862:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1645 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.233877:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd164c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.233886:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd164c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.233909:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd164c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788330203.234414:0:12916:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788330203.234911:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1653 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.234925:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.234934:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.234975:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1645 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.234983:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1645 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.234990:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1645 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.234996:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330203.235001:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1645 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.235008:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1645 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.235024:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:1.0:1788330203.235027:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330203.235044:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1645 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.235051:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1645 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788330203.235069:0:12916:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b1ac629c reply state 000000007a8de35d transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd164c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.235083:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd164c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.235089:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eecbb95500) 00010000:00010000:1.0:1788330203.235091:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788330203.235096:0:12916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788330203.235142:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd163e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f29 expref: 37 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.235224:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1653 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f29 expref: 36 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.235233:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acb00) 00010000:00010000:1.0:1788330203.235235:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788330203.235238:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79400, rc 0) 00000100:00100000:1.0:1788330203.235878:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+37:11363:x1875199766094208:12345-192.168.202.50@tcp:101:bash.0 Request processed in 2437us (6927us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788330203.235891:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 107 00000100:00100000:2.0:1788330203.242639:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330203.242936:0:13829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766094336 00000100:00100000:0.0:1788330203.242951:0:13829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766094336 00000100:00100000:0.0:1788330203.243075:0:13829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:0.0:1788330203.243089:0:13829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2411:x1875199766094336:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:0.0:1788330203.243118:0:13829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330203.243180:0:13829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9ea1e98/0x8475908e9fd1661 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f30 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788330203.243217:0:13829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330203.243249:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=407s v=(0 0) 00010000:00010000:0.0:1788330203.243266:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330203.243279:0:13829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9ea1e98/0x8475908e9fd1661 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f30 expref: 8 pid: 13829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.243332:0:13829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b9ea1e98/0x8475908e9fd1661 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f30 expref: 8 pid: 13829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.243645:0:13829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327800, rc 0) 00000100:00100000:0.0:1788330203.243824:0:13829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2411:x1875199766094336:12345-192.168.202.50@tcp:101:bash.0 Request processed in 735us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330203.243833:0:13829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:1.0:1788330203.247929:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330203.248074:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766094464 00000100:00100000:2.0:1788330203.248090:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766094464 00000100:00100000:2.0:1788330203.248278:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:2.0:1788330203.248303:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:11363:x1875199766094464:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1788330203.248331:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330203.248360:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e78b9fd2/0x8475908e9fd1668 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f37 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.248407:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b9ea1e98/0x8475908e9fd1661 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f30 expref: 9 pid: 13829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.248452:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330203.248458:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330203.248466:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e78b9fd2/0x8475908e9fd1668 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f37 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.248753:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b9ea1e98/0x8475908e9fd1661 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f30 expref: 9 pid: 13829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.248774:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b9ea1e98/0x8475908e9fd1661 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f30 expref: 9 pid: 13829 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330203.248794:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1875199792391808:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330203.248939:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc764b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330203.253483:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1875199792391808:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330203.253802:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e78b9fd2/0x8475908e9fd1668 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f37 expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.253832:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038000, rc 0) 00000100:00100000:0.0:1788330203.253985:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:11363:x1875199766094464:12345-192.168.202.50@tcp:101:bash.0 Request processed in 5694us (6070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330203.253997:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:1.0:1788330203.255811:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330203.256044:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766094592 00000100:00100000:0.0:1788330203.256056:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766094592 00010000:00010000:0.0:1788330203.256109:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b9ea1e98/0x8475908e9fd1661 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f30 expref: 9 pid: 13829 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330203.256172:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00100000:0.0:1788330203.256184:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:2412:x1875199766094592:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330203.256200:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330203.256242:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b9ea1e98/0x8475908e9fd1661 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f30 expref: 9 pid: 13829 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.256269:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b9ea1e98/0x8475908e9fd1661 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f30 expref: 9 pid: 13829 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.256350:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9ea1e98/0x8475908e9fd1661 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f30 expref: 9 pid: 13829 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.256370:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330203.256375:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330203.256384:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e78b9fd2/0x8475908e9fd1668 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f37 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.256395:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e78b9fd2/0x8475908e9fd1668 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f37 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.256446:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e78b9fd2/0x8475908e9fd1668 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f37 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330203.256463:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e75c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6507:1875199792391936:192.168.202.50@tcp:105: 00000100:00100000:0.0:1788330203.256996:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330203.265144:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e75c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6507:1875199792391936:192.168.202.50@tcp:105: 00010000:00010000:0.0:1788330203.265223:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330203.265612:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330203.266185:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766094848 00000100:00100000:2.0:1788330203.266196:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766094848 00000100:00100000:2.0:1788330203.266268:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:2.0:1788330203.266280:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+37:11363:x1875199766094848:12345-192.168.202.50@tcp:35:bash.0 00000100:00100000:2.0:1788330203.267384:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+38:11363:x1875199766094848:12345-192.168.202.50@tcp:35:bash.0 Request processed in 1097us (1767us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788330203.267397:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:0.0:1788330203.267483:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2412:x1875199766094592:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 11299us (11687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330203.267519:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00100000:3.0:1788330203.450388:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330203.450906:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766094976 00000100:00100000:0.0:1788330203.450924:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766094976 00000100:00100000:0.0:1788330203.451017:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 108 00000100:00100000:0.0:1788330203.451031:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+38:11379:x1875199766094976:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330203.451067:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330203.451097:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd166f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f3e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.451654:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1676 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.451685:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.451701:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330203.451753:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788330203.451757:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788330203.451781:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.451812:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd166f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f3e expref: 40 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.451835:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1676 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f3e expref: 39 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.451857:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:0.0:1788330203.451861:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788330203.451865:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326e00, rc 0) 00000100:00100000:0.0:1788330203.451960:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+39:11379:x1875199766094976:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 931us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330203.451970:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 108 00000100:00100000:3.0:1788330203.458141:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330203.458355:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766095232 00000100:00100000:2.0:1788330203.458371:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766095232 00000100:00100000:2.0:1788330203.458462:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 109 00000100:00100000:2.0:1788330203.458476:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+39:11379:x1875199766095232:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330203.458540:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330203.458570:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd167d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f45 expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.459361:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1684 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.459384:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1684 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.459402:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1684 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330203.459418:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788330203.459929:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd167d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f45 expref: 42 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.459954:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1684 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f45 expref: 41 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.459964:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acb00) 00010000:00010000:2.0:1788330203.459967:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330203.459971:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038400, rc 0) 00000100:00100000:2.0:1788330203.460263:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+41:11379:x1875199766095232:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1779us (2128us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1788330203.460273:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 109 00000100:00100000:3.0:1788330203.465313:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330203.465377:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330203.465825:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766095488 00000100:00100000:2.0:1788330203.465842:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766095488 00000100:00100000:2.0:1788330203.465932:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 110 00000100:00100000:2.0:1788330203.465963:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+41:11379:x1875199766095488:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330203.465999:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330203.466026:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1692 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f4c expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.466195:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1699 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.466215:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1699 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.466231:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1699 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330203.466247:0:12916:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788330203.466443:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1692 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f4c expref: 44 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.466467:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1699 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f4c expref: 43 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.466479:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acb00) 00010000:00010000:2.0:1788330203.466482:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788330203.467007:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039600, rc 0) 00000100:00100000:2.0:1788330203.467113:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+43:11379:x1875199766095488:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1151us (1826us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1788330203.467123:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 110 00000100:00100000:0.0:1788330203.467274:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766095616 00000100:00100000:0.0:1788330203.467283:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766095616 00000100:00100000:0.0:1788330203.467354:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:0.0:1788330203.467365:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+43:2412:x1875199766095616:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330203.467379:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330203.467403:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1684 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f45 expref: 43 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.467859:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acb00) 00010000:00010000:0.0:1788330203.467866:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330203.467908:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+42:2412:x1875199766095616:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 544us (2530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330203.467917:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:0.0:1788330203.478464:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330203.478796:0:13409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766095744 00000100:00100000:3.0:1788330203.478814:0:13409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766095744 00000100:00100000:3.0:1788330203.478903:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:3.0:1788330203.478916:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2410:x1875199766095744:12345-192.168.202.50@tcp:1:lfs.0 00010000:00010000:3.0:1788330203.478976:0:13409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd16a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.479024:0:13409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e78b9fd2/0x8475908e9fd1668 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f37 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.479034:0:13409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330203.479039:0:13409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788330203.479045:0:13409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd16a7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.479096:0:13409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e78b9fd2/0x8475908e9fd1668 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f37 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.479113:0:13409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e78b9fd2/0x8475908e9fd1668 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f37 expref: 8 pid: 8440 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330203.479132:0:13409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13409:1875199792392064:192.168.202.50@tcp:104: 00000100:00100000:3.0:1788330203.479494:0:13409:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10a53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330203.483201:0:13409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13409:1875199792392064:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330203.483246:0:13409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd16a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330203.485208:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330203.485467:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766095872 00000100:00100000:3.0:1788330203.485480:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766095872 00002000:00100000:3.0:1788330203.485556:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff99edc7e74700 x1875199766095872/t0(0) o4->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:219/0 lens 504/0 e 0 to 0 dl 1788330214 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788330203.485568:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99edc7e74700 with x1875199766095872 ext(0->8) 00010000:00010000:3.0:1788330203.485590:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e78b9fd2/0x8475908e9fd1668 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f37 expref: 9 pid: 8440 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.485610:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e78b9fd2/0x8475908e9fd1668 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f37 expref: 9 pid: 8440 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788330203.485635:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99edc7e74700 00000100:00100000:3.0:1788330203.485684:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:3.0:1788330203.485698:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:2412:x1875199766095872:12345-192.168.202.50@tcp:4:lfs.0 00000100:00100000:3.0:1788330203.487457:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+11:2412:x1875199766095872:12345-192.168.202.50@tcp:4:lfs.0 Request processed in 1746us (2247us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788330203.487476:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 1 00002000:00100000:3.0:1788330203.487489:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff99edc7e74700 x1875199766095872/t4294967303(0) o4->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:219/0 lens 504/448 e 0 to 0 dl 1788330214 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788330203.487500:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99edc7e74700 with x1875199766095872 ext(0->8) 00010000:00010000:3.0:1788330203.487511:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e78b9fd2/0x8475908e9fd1668 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f37 expref: 11 pid: 8440 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.487532:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e78b9fd2/0x8475908e9fd1668 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f37 expref: 11 pid: 8440 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788330203.487540:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99edc7e74700 00000100:00100000:3.0:1788330203.491102:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330203.491231:0:13195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766096000 00000100:00100000:1.0:1788330203.491273:0:13195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766096000 00010000:00010000:1.0:1788330203.491344:0:13195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e78b9fd2/0x8475908e9fd1668 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f37 expref: 11 pid: 8440 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330203.491402:0:13195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 68 00000100:00100000:1.0:1788330203.491783:0:13195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec986d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+11:2411:x1875199766096000:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330203.491808:0:13195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788330203.491833:0:13195:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788330203.491837:0:13195:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788330203 00002000:00010000:1.0:1788330203.491839:0:13195:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788330203 00002000:00010000:1.0:1788330203.491841:0:13195:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788330203 00002000:00010000:1.0:1788330203.491844:0:13195:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788330203.491852:0:13195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e78b9fd2/0x8475908e9fd1668 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f37 expref: 11 pid: 8440 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.491869:0:13195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e78b9fd2/0x8475908e9fd1668 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f37 expref: 11 pid: 8440 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.491902:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e78b9fd2/0x8475908e9fd1668 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f37 expref: 11 pid: 8440 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.491924:0:13195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330203.491930:0:13195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330203.491936:0:13195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd16a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.491947:0:13195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd16a7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.492004:0:13195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330203.492092:0:13195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec986d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+10:2411:x1875199766096000:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 678us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330203.492101:0:13195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 68 00010000:00010000:0.0:1788330203.493638:0:13409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd16a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.493660:0:13409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd16a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.493708:0:13409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd16a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.493717:0:13409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd16a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.493725:0:13409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd16a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.493733:0:13409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59ca600 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330203.493738:0:13409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd16a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.493749:0:13409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd16a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.493771:0:13409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd16a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.493800:0:13409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd16a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330203.493927:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:2410:x1875199766095744:12345-192.168.202.50@tcp:1:lfs.0 Request processed in 15007us (15474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330203.493938:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:3.0:1788330203.499071:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330203.499207:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766096256 00000100:00100000:1.0:1788330203.499221:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766096256 00000100:00100000:1.0:1788330203.499322:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00100000:1.0:1788330203.499337:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9247c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+42:11379:x1875199766096256:12345-192.168.202.50@tcp:35:lfs.0 00000004:00010000:1.0:1788330203.499438:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1699 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f4c expref: 42 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788330203.500055:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1788330203.500095:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788330203.501995:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1788330203.502107:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd16ae lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.502137:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1653 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f29 expref: 46 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.502148:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd16ae lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.502227:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1653 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f29 expref: 46 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.502247:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1653 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f29 expref: 46 pid: 12916 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330203.502301:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f75180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1875199792392192:192.168.202.50@tcp:104: 00000100:00100000:1.0:1788330203.502451:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788330203.506229:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f75180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1875199792392192:192.168.202.50@tcp:104: 00010000:00010000:1.0:1788330203.506280:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd16ae lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330203.508093:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330203.508211:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766096384 00000100:00100000:0.0:1788330203.508226:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766096384 00010000:00010000:0.0:1788330203.508303:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1653 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f29 expref: 47 pid: 12916 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330203.508361:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 69 00000100:00100000:0.0:1788330203.508373:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+47:2413:x1875199766096384:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330203.508393:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330203.508401:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1653 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f29 expref: 47 pid: 12916 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.508571:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1653 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f29 expref: 47 pid: 12916 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.508661:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1653 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f29 expref: 47 pid: 12916 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.508744:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acb00) 00010000:00010000:0.0:1788330203.508751:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd16ae lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.508777:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd16ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.508785:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd16ae lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.508823:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330203.508906:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+46:2413:x1875199766096384:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 535us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330203.508914:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 69 00010000:00010000:1.0:1788330203.509974:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd16ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.509989:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd16ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788330203.510186:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1788330203.510375:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1788330203.510861:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f75180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875199792392320:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788330203.510950:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330203.510983:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788330203.511113:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792392320 00000100:00100000:0.0:1788330203.511123:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792392320 00000100:00100000:0.0:1788330203.511209:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788330203.511220:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6526:x1875199792392320:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788330203.511554:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6526:x1875199792392320:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 335us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330203.511563:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788330203.511954:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f75180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875199792392320:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788330203.512146:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1788330203.513262:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f75180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875199792392448:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788330203.513349:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330203.513383:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788330203.513852:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792392448 00000100:00100000:2.0:1788330203.513862:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792392448 00000100:00100000:2.0:1788330203.513945:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788330203.513957:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6526:x1875199792392448:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788330203.514234:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6526:x1875199792392448:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 279us (884us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788330203.514242:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788330203.514573:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f75180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875199792392448:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788330203.514862:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1788330203.514922:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd16ae lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.514944:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd16ae lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.514953:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd16ae lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.514959:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330203.514965:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd16ae lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.514973:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd16ae lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.514995:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acb00) 00010000:00010000:1.0:1788330203.514998:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788330203.515005:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd16ae lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.515010:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd16ae lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788330203.515188:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788330203.515282:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788330203.516143:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 407487989559ns, next at 408487983801ns, rc = 0 00000001:00080000:1.0:1788330203.516190:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1788330203.516267:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acb00) 00010000:00010000:1.0:1788330203.516272:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788330203.516285:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1699 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f4c expref: 50 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330203.516500:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9247c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+49:11379:x1875199766096256:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 17164us (17445us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788330203.516513:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 26 00000020:00080000:1.0:1788330203.516520:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788330203.520980:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330203.521082:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766096512 00000100:00100000:1.0:1788330203.521096:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766096512 00000100:00100000:1.0:1788330203.521217:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 111 00000100:00100000:1.0:1788330203.521230:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+49:11379:x1875199766096512:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1788330203.521272:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330203.521317:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd16b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f53 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.521395:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd16b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f53 expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.521414:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd16b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f53 expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.521446:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:1.0:1788330203.521450:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330203.521454:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79400, rc 0) 00000100:00100000:1.0:1788330203.521530:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+50:11379:x1875199766096512:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 302us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330203.521538:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 111 00000100:00100000:3.0:1788330203.526374:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330203.526506:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766096768 00000100:00100000:2.0:1788330203.526520:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766096768 00000100:00100000:2.0:1788330203.526608:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:2.0:1788330203.526622:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+50:11379:x1875199766096768:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:2.0:1788330203.526946:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+51:11379:x1875199766096768:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 325us (589us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788330203.526954:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:3.0:1788330203.638538:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330203.638700:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766096896 00000100:00100000:2.0:1788330203.638717:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766096896 00000100:00100000:2.0:1788330203.638806:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 112 00000100:00100000:2.0:1788330203.638819:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+51:11389:x1875199766096896:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:2.0:1788330203.638935:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd16bc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.638960:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd16bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.638975:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd16bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.638988:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd16c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.638995:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd16c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639018:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd16c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639120:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639128:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639135:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330203.639243:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639274:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd16bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639281:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd16bc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639289:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd16bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639294:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330203.639299:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd16bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639308:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd16bc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639325:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:2.0:1788330203.639334:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330203.639341:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd16bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639349:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd16bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639367:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd16c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639374:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd16c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639380:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd16c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639385:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330203.639388:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd16c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639395:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd16c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639404:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eecbb95500) 00010000:00010000:2.0:1788330203.639406:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330203.639409:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd16c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639416:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd16c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639429:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639440:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639446:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639450:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330203.639453:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639459:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639466:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:2.0:1788330203.639469:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330203.639472:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.639477:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330203.639931:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+51:11389:x1875199766096896:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 1109us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330203.639942:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 112 00000100:00100000:3.0:1788330203.682842:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330203.682994:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766097152 00000100:00100000:2.0:1788330203.683011:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766097152 00000100:00100000:2.0:1788330203.683108:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 113 00000100:00100000:2.0:1788330203.683123:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+51:11392:x1875199766097152:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330203.683456:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330203.683777:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd16d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f5a expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.683898:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd16d8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.683918:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd16d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.683931:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd16d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.683945:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd16df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.683952:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd16df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.683959:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd16df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.684107:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd16e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.684115:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd16e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.684123:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd16e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330203.684134:0:12916:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788330203.684268:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd16d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.684276:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd16d8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.684289:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd16d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.684296:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330203.684301:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd16d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.684309:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd16d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.684323:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:3.0:1788330203.684327:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330203.684332:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd16d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.684700:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd16d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.684720:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd16df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.684728:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd16df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.684733:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd16df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.684738:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59ca600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330203.684741:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd16df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.684759:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd16df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.684769:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eecbb95500) 00010000:00010000:3.0:1788330203.684772:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330203.684775:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd16df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.684781:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd16df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.688025:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd16d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f5a expref: 54 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.688259:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd16e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f5a expref: 53 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.688273:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:3.0:1788330203.688277:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788330203.688280:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cb200, rc 0) 00000100:00100000:3.0:1788330203.688968:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+53:11392:x1875199766097152:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 5841us (6141us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788330203.688980:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 113 00000100:00100000:0.0:1788330203.693025:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330203.693139:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766097280 00000100:00100000:2.0:1788330203.693409:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766097280 00000100:00100000:2.0:1788330203.693649:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 114 00000100:00100000:2.0:1788330203.693664:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+53:11392:x1875199766097280:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:2.0:1788330203.693851:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.693873:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.693887:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.693938:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.693946:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.693954:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.693960:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330203.693965:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.693973:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.693988:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:2.0:1788330203.693990:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788330203.693997:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.694022:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd16f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330203.694215:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+53:11392:x1875199766097280:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 551us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330203.694224:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 114 00000100:00100000:0.0:1788330203.698404:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330203.698559:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766097536 00000100:00100000:2.0:1788330203.698574:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766097536 00000100:00100000:2.0:1788330203.698834:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:2.0:1788330203.698849:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+53:11392:x1875199766097536:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:2.0:1788330203.699193:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+54:11392:x1875199766097536:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 347us (803us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1788330203.699202:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:0.0:1788330203.784055:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330203.784376:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766097792 00000100:00100000:3.0:1788330203.784391:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766097792 00000100:00100000:3.0:1788330203.784499:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 115 00000100:00100000:3.0:1788330203.784512:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+54:11402:x1875199766097792:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:3.0:1788330203.784569:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330203.784573:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788330203.784626:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1676 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f3e expref: 54 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.784651:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:3.0:1788330203.784657:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330203.784793:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd16fb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f61 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.784941:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1702 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.784957:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd16e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f5a expref: 54 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.784968:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1702 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.785011:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd16e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f5a expref: 54 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.785026:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd16e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f5a expref: 54 pid: 12916 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330203.785044:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1875199792392576:192.168.202.50@tcp:104: 00000100:00100000:3.0:1788330203.785330:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10a53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330203.793585:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330203.793892:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766097920 00000100:00100000:2.0:1788330203.793907:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766097920 00010000:00010000:2.0:1788330203.793961:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd16e6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f5a expref: 55 pid: 12916 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330203.794004:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 70 00000100:00100000:2.0:1788330203.794016:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+55:2412:x1875199766097920:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330203.794032:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330203.794040:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd16e6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f5a expref: 55 pid: 12916 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.794055:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd16e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f5a expref: 55 pid: 12916 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.794108:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:2.0:1788330203.794114:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1702 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.794126:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1702 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.794135:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1702 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.794180:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330203.794263:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+55:2412:x1875199766097920:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 235us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330203.794271:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 70 00010000:00010000:3.0:1788330203.801061:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd16e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f5a expref: 54 pid: 12916 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330203.801123:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1875199792392576:192.168.202.50@tcp:104: 00010000:00010000:3.0:1788330203.801281:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1702 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.801306:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1702 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.801314:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1702 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330203.801345:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788330203.801578:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd16fb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f61 expref: 55 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.801599:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1702 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f61 expref: 54 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330203.801612:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:3.0:1788330203.801616:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788330203.801621:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59ca600, rc 0) 00000100:00100000:3.0:1788330203.801750:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+54:11402:x1875199766097792:12345-192.168.202.50@tcp:101:bash.0 Request processed in 17238us (17709us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788330203.801763:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 115 00000100:00100000:0.0:1788330203.807111:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330203.809170:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766098048 00000100:00100000:3.0:1788330203.809196:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766098048 00000100:00100000:3.0:1788330203.809321:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 116 00000100:00100000:3.0:1788330203.809336:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+54:11402:x1875199766098048:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:3.0:1788330203.809392:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330203.809919:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1710 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f68 expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.809993:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1717 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.810011:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1717 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.810027:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1717 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.810213:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1710 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f68 expref: 56 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.810235:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1717 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f68 expref: 55 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.810245:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:1.0:1788330203.810259:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788330203.810264:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78200, rc 0) 00000100:00100000:1.0:1788330203.810375:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+55:11402:x1875199766098048:12345-192.168.202.50@tcp:101:bash.0 Request processed in 1042us (3283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330203.810384:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 116 00000100:00100000:0.0:1788330203.819704:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330203.820055:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766098304 00000100:00100000:2.0:1788330203.820069:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766098304 00000100:00100000:2.0:1788330203.820186:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 117 00000100:00100000:2.0:1788330203.820199:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+55:11402:x1875199766098304:12345-192.168.202.50@tcp:36:bash.0 00010000:00010000:2.0:1788330203.820540:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd171e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.820565:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd171e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.820784:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd171e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788330203.821194:0:7832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1788330203.821232:0:7832:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000dc06b054 reply state 00000000a07313d7 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd171e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.821275:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd171e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.821286:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:2.0:1788330203.821289:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788330203.821295:0:7832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330203.821427:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+58:11402:x1875199766098304:12345-192.168.202.50@tcp:36:bash.0 Request processed in 1226us (1736us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788330203.821437:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 117 00000020:00080000:2.0:1788330203.821444:0:7832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788330203.826733:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330203.826971:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766098432 00000100:00100000:3.0:1788330203.826985:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766098432 00000100:00100000:3.0:1788330203.827065:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 118 00000100:00100000:3.0:1788330203.827080:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+58:11402:x1875199766098432:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:3.0:1788330203.827118:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330203.827266:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1725 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f6f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.827801:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd172c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.828048:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1702 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f61 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.828059:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd172c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.828104:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1702 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f61 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.828120:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1702 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f61 expref: 59 pid: 6524 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330203.828137:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1875199792392704:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330203.828281:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc764b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788330203.832362:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330203.832481:0:13195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766098560 00000100:00100000:1.0:1788330203.832507:0:13195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766098560 00010000:00010000:1.0:1788330203.832570:0:13195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1702 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f61 expref: 60 pid: 6524 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330203.832624:0:13195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 71 00000100:00100000:1.0:1788330203.832637:0:13195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+60:2412:x1875199766098560:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330203.832671:0:13195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330203.832681:0:13195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1702 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f61 expref: 60 pid: 6524 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.832699:0:13195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1702 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f61 expref: 60 pid: 6524 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.832735:0:13195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:1.0:1788330203.832741:0:13195:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd172c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.832755:0:13195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd172c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.832765:0:13195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd172c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.832793:0:13195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330203.833098:0:13195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+60:2412:x1875199766098560:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 461us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330203.833108:0:13195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 71 00010000:00010000:2.0:1788330203.833246:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1702 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f61 expref: 59 pid: 6524 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330203.833287:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1875199792392704:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330203.833321:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd172c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.833333:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd172c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.833340:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd172c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330203.833421:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788330203.833426:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330203.833456:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd172c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.833500:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1725 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f6f expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.833516:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd172c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f6f expref: 58 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.833524:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:2.0:1788330203.833527:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330203.833530:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038800, rc 0) 00000100:00100000:2.0:1788330203.833566:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+58:11402:x1875199766098432:12345-192.168.202.50@tcp:101:bash.0 Request processed in 6489us (6849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330203.833573:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 118 00000100:00100000:0.0:1788330203.838676:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330203.839236:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766098816 00000100:00100000:1.0:1788330203.839261:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766098816 00000100:00100000:1.0:1788330203.839406:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 29 00000100:00100000:1.0:1788330203.839432:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+58:11402:x1875199766098816:12345-192.168.202.50@tcp:35:bash.0 00000100:00100000:1.0:1788330203.839785:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+59:11402:x1875199766098816:12345-192.168.202.50@tcp:35:bash.0 Request processed in 355us (1128us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1788330203.839795:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 29 00000100:00100000:2.0:1788330203.926946:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330203.927108:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766098944 00000100:00100000:1.0:1788330203.927123:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766098944 00000100:00100000:1.0:1788330203.927430:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 119 00000100:00100000:1.0:1788330203.927446:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+59:11408:x1875199766098944:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1788330203.927496:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330203.927527:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1733 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f76 expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.927632:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd173a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.927652:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd173a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.927678:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd173a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330203.927743:0:12916:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788330203.927748:0:12916:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788330203.927774:0:12916:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd173a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.927806:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1733 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f76 expref: 61 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.927828:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd173a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f76 expref: 60 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.927838:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:1.0:1788330203.927842:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788330203.927854:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79c00, rc 0) 00000100:00100000:1.0:1788330203.927944:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+60:11408:x1875199766098944:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 501us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330203.927953:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 119 00000100:00100000:0.0:1788330203.933423:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330203.933825:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766099072 00000100:00100000:2.0:1788330203.933842:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766099072 00000100:00100000:2.0:1788330203.933912:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 120 00000100:00100000:2.0:1788330203.933924:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+60:11408:x1875199766099072:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330203.933955:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330203.933985:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1741 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f7d expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934078:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1748 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934098:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1748 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934114:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1748 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934126:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd174f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934134:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd174f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934140:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd174f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934273:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1756 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934299:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1756 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934319:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1756 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330203.934656:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788330203.934661:0:7832:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330203.934771:0:7832:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1756 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934789:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1756 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934799:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1748 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934807:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1748 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934815:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1748 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934822:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330203.934827:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1748 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934837:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1748 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934852:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:2.0:1788330203.934856:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330203.934861:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1748 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934883:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1748 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934902:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd174f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934909:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd174f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934915:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd174f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934921:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330203.934924:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd174f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934930:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd174f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934938:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eecbb95500) 00010000:00010000:2.0:1788330203.934941:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330203.934944:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd174f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934950:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd174f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.934987:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1741 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f7d expref: 62 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.935003:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1756 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f7d expref: 61 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.935017:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:2.0:1788330203.935019:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330203.935023:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038400, rc 0) 00000100:00100000:2.0:1788330203.935123:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+61:11408:x1875199766099072:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1200us (1729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330203.935132:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 120 00000100:00100000:3.0:1788330203.939379:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330203.939441:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330203.939799:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766099456 00000100:00100000:0.0:1788330203.939814:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766099456 00000100:00100000:0.0:1788330203.939918:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:0.0:1788330203.939936:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+61:2413:x1875199766099456:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330203.939956:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330203.939990:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1756 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f7d expref: 61 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.940016:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:0.0:1788330203.940022:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330203.940110:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+60:2413:x1875199766099456:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 181us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330203.940118:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:2.0:1788330203.941221:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766099328 00000100:00100000:2.0:1788330203.941235:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766099328 00000100:00100000:2.0:1788330203.941971:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 121 00000100:00100000:2.0:1788330203.941989:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+60:11408:x1875199766099328:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330203.942017:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330203.942042:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd175d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f84 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.942236:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1764 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.942268:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd172c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f6f expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.942280:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1764 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.942357:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd172c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f6f expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.942375:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd172c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f6f expref: 61 pid: 6524 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330203.942425:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1875199792392832:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330203.942611:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc764b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788330203.950873:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330203.951361:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766099584 00000100:00100000:0.0:1788330203.951375:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766099584 00010000:00010000:0.0:1788330203.951456:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd172c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f6f expref: 62 pid: 6524 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330203.951523:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 72 00000100:00100000:0.0:1788330203.951536:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+62:2412:x1875199766099584:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330203.951556:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330203.951566:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd172c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f6f expref: 62 pid: 6524 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.951583:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd172c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f6f expref: 62 pid: 6524 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.951646:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:0.0:1788330203.951655:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1764 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.951681:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1764 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.951691:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1764 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.951718:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330203.951815:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+62:2412:x1875199766099584:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 279us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330203.951824:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 72 00010000:00010000:2.0:1788330203.954964:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd172c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f6f expref: 61 pid: 6524 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330203.955004:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1875199792392832:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330203.955037:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1764 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.955049:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1764 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.955056:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1764 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330203.955084:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788330203.955403:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd175d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f84 expref: 62 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.955436:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1764 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f84 expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.955448:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:2.0:1788330203.955451:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788330203.955456:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039200, rc 0) 00000100:00100000:2.0:1788330203.955567:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+61:11408:x1875199766099328:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 13583us (16204us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788330203.955596:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 121 00000100:00100000:3.0:1788330203.962867:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330203.962973:0:13195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766099840 00000100:00100000:1.0:1788330203.962991:0:13195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766099840 00000100:00100000:1.0:1788330203.963104:0:13195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:1.0:1788330203.963119:0:13195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+61:11408:x1875199766099840:12345-192.168.202.50@tcp:103:lfs.0 00010000:00010000:1.0:1788330203.963140:0:13195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330203.963216:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd16b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f53 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.963241:0:13195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:1.0:1788330203.963258:0:13195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330203.963655:0:13195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+60:11408:x1875199766099840:12345-192.168.202.50@tcp:103:lfs.0 Request processed in 536us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330203.963673:0:13195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:1.0:1788330203.969491:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330203.969717:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766099968 00000100:00100000:2.0:1788330203.969729:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766099968 00000100:00100000:2.0:1788330203.969793:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 122 00000100:00100000:2.0:1788330203.969805:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+60:11408:x1875199766099968:12345-192.168.202.50@tcp:58:lfs.0 00010000:00010000:2.0:1788330203.969949:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1772 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.969977:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1772 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.969990:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1772 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788330203.970101:0:12916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788330203.970291:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+60:11408:x1875199766099968:12345-192.168.202.50@tcp:58:lfs.0 Request processed in 486us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330203.970299:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 122 00000100:00100000:3.0:1788330203.972897:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330203.973087:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766100096 00000100:00100000:2.0:1788330203.973100:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766100096 00000100:00100000:2.0:1788330203.973304:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 123 00000100:00100000:2.0:1788330203.973317:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+60:11408:x1875199766100096:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330203.973345:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330203.973374:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd1779 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f8b expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.973463:0:7832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1772 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.973507:0:7832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd1779 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f8b expref: 61 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.973530:0:7832:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1772 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.973546:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd1779 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f8b expref: 61 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.973563:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:2.0:1788330203.973566:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788330203.973571:0:7832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd1779 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f8b expref: 61 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.973579:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038800, rc 0) 00000100:00100000:2.0:1788330203.973655:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+61:11408:x1875199766100096:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 340us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330203.973673:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 123 00000040:00080000:3.0:1788330203.995499:0:13809:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788330203.995515:0:13809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788330203.995582:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788330203.995596:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788330203.995816:0:13809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc76dc380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13809:1875199792392960:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788330203.996026:0:13809:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eed30e9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788330204.004030:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330204.004325:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766100224 00000100:00100000:0.0:1788330204.004341:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766100224 00000100:00100000:0.0:1788330204.004420:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 124 00000100:00100000:0.0:1788330204.004433:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+62:11409:x1875199766100224:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788330204.004509:0:6524:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788330204.004677:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+62:11409:x1875199766100224:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 244us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330204.004686:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 124 00000100:00100000:2.0:1788330204.005922:0:13809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc76dc380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13809:1875199792392960:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788330204.012869:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330204.012974:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766100352 00000100:00100000:1.0:1788330204.012989:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766100352 00000100:00100000:1.0:1788330204.013077:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 125 00000100:00100000:1.0:1788330204.013092:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+61:11409:x1875199766100352:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788330204.013256:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1780 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.013280:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1780 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.013998:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1780 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014025:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1787 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014034:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1787 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014041:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1787 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014071:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd178e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014081:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd178e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014088:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd178e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330204.014188:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788330204.014195:0:6522:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788330204.014216:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd178e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014228:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1780 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014234:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1780 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014267:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1780 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014274:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330204.014281:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1780 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014291:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1780 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014761:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99eec9216d00) 00010000:00010000:1.0:1788330204.014765:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330204.014771:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1780 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014778:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1780 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014795:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1787 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014802:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1787 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014808:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1787 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014814:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330204.014817:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1787 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014836:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1787 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014845:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff99edc75acb00) 00010000:00010000:1.0:1788330204.014847:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330204.014850:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1787 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014856:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1787 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014875:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd178e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014881:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd178e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014888:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd178e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014893:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330204.014897:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd178e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014904:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd178e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014911:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:1.0:1788330204.014914:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330204.014917:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd178e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.014933:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd178e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330204.015077:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+61:11409:x1875199766100352:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 Request processed in 1982us (2221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330204.015090:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 125 00000100:00100000:3.0:1788330204.022865:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330204.022996:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766100608 00000100:00100000:0.0:1788330204.023012:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766100608 00000100:00100000:0.0:1788330204.023099:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 126 00000100:00100000:0.0:1788330204.023113:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+61:11409:x1875199766100608:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330204.023238:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330204.023276:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1795 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f92 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.023860:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd179c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.023880:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd179c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.023894:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd179c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330204.023908:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788330204.024014:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd179c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.024022:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd179c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.024029:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd179c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.024034:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330204.024039:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd179c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.024047:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd179c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.024060:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:0.0:1788330204.024070:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788330204.024076:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd179c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.024082:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd179c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.024135:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1795 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f92 expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.024146:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99eec9216d00) 00010000:00010000:0.0:1788330204.024148:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330204.024653:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1795 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f92 expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.024716:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327000, rc 0) 00000100:00100000:1.0:1788330204.024914:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+62:11409:x1875199766100608:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 1800us (2351us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1788330204.024924:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 126 00000100:00100000:3.0:1788330204.028372:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330204.028516:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766100736 00000100:00100000:2.0:1788330204.028533:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766100736 00000100:00100000:2.0:1788330204.028617:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 127 00000100:00100000:2.0:1788330204.028629:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+62:11409:x1875199766100736:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788330204.028915:0:12916:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788330204.029069:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+62:11409:x1875199766100736:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 441us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330204.029099:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 127 00000100:00100000:0.0:1788330204.033376:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330204.033497:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766100992 00000100:00100000:1.0:1788330204.033520:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766100992 00000100:00100000:2.0:1788330204.034857:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 128 00000100:00100000:2.0:1788330204.034887:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+62:11409:x1875199766100992:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330204.034923:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330204.034927:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788330204.034972:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd173a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f76 expref: 62 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.034996:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:2.0:1788330204.035002:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330204.035021:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd17aa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105f99 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788330204.035663:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788330204.037852:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd17b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.037886:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd17b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.037901:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd17b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.038004:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd17aa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f99 expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.038031:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd17b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f99 expref: 63 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.038062:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99eecbb95400) 00010000:00010000:2.0:1788330204.038066:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330204.038071:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038000, rc 0) 00000100:00100000:2.0:1788330204.038455:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+63:11409:x1875199766100992:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 3579us (5092us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788330204.038466:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 128 00000100:00100000:3.0:1788330204.044968:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330204.045873:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766101248 00000100:00100000:1.0:1788330204.045891:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766101248 00000100:00100000:1.0:1788330204.045995:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 129 00000100:00100000:1.0:1788330204.046010:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+63:11409:x1875199766101248:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788330204.046119:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330204.046192:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd17b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f99 expref: 63 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.046217:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99eecbb95400) 00010000:00010000:1.0:1788330204.046229:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788330204.046267:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd17bf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.046295:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd17bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.046306:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd17bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.046340:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd17c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x6a8dfcca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.046349:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd17c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6a8dfcca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.046356:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd17c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6a8dfcca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.046447:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd17bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.046456:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd17bf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.046464:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd17bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.046471:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330204.046476:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd17bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.046495:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd17bf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.047964:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:1.0:1788330204.047975:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330204.047984:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd17bf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.047994:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd17bf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.048035:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd17c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x6a8dfcca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.048042:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd17c6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6a8dfcca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.048049:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd17c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6a8dfcca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.048055:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330204.048060:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd17c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6a8dfcca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.048067:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd17c6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x6a8dfcca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.048084:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x6a8dfcca (ffff99edc75acb00) 00010000:00010000:1.0:1788330204.048087:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330204.048090:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd17c6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x6a8dfcca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.048096:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd17c6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x6a8dfcca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330204.052965:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+62:11409:x1875199766101248:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 3401us (4701us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788330204.052983:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 129 00000100:00100000:2.0:1788330204.055232:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330204.055887:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766101376 00000100:00100000:3.0:1788330204.055906:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766101376 00000100:00100000:3.0:1788330204.056035:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 130 00000100:00100000:3.0:1788330204.056065:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+62:11409:x1875199766101376:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330204.056093:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330204.056124:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd17cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105fa0 expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.056219:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd17d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.056236:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd17d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.056263:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd17d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.056844:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd17cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fa0 expref: 64 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.056871:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd17d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fa0 expref: 63 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.056880:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99edc7580900) 00010000:00010000:3.0:1788330204.056883:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788330204.056887:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59ca000, rc 0) 00000100:00100000:3.0:1788330204.056981:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+63:11409:x1875199766101376:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 920us (1763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330204.056991:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 130 00010000:00010000:0.0:1788330204.059605:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788330204.067198:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1788330204.067218:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1788330204.070655:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330204.071444:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766101632 00000100:00100000:2.0:1788330204.071467:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766101632 00000100:00100000:2.0:1788330204.071617:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 131 00000100:00100000:2.0:1788330204.071634:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+63:11409:x1875199766101632:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788330204.071905:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd17db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.071931:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd17db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.071948:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd17db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788330204.072876:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:2.0:1788330204.072965:0:6524:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000082c8c3b3 reply state 00000000ab89887a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd17db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.072988:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd17db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.072999:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99edc7580900) 00010000:00010000:2.0:1788330204.073018:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788330204.073025:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330204.073220:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+65:11409:x1875199766101632:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 1585us (2581us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788330204.073231:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 131 00000100:00100000:0.0:1788330204.078384:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330204.078906:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766101760 00000100:00100000:1.0:1788330204.078941:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766101760 00000100:00100000:1.0:1788330204.079096:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 132 00000100:00100000:1.0:1788330204.079113:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+65:11409:x1875199766101760:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330204.079186:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330204.079222:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd17e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105fa7 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.079328:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd17e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fa7 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.079346:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd17e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fa7 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.079371:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99edc7580900) 00010000:00010000:1.0:1788330204.079375:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330204.079380:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78000, rc 0) 00000100:00100000:1.0:1788330204.079482:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+66:11409:x1875199766101760:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 372us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330204.079490:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 132 00000100:00100000:1.0:1788330204.084704:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330204.084930:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766101888 00000100:00100000:3.0:1788330204.084944:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766101888 00000100:00100000:3.0:1788330204.085039:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 45 00000100:00100000:3.0:1788330204.085071:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2410:x1875199766101888:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788330204.085750:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:2410:x1875199766101888:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 680us (1061us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788330204.085762:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 45 00000100:00080000:1.0:1788330204.086061:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330204.091920:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330204.092042:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766102144 00000100:00100000:3.0:1788330204.092056:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766102144 00000100:00100000:3.0:1788330204.092217:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:3.0:1788330204.092232:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+66:11409:x1875199766102144:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788330204.092791:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+67:11409:x1875199766102144:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 558us (882us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1788330204.092804:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:2.0:1788330204.096394:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330204.097130:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766102400 00000100:00100000:3.0:1788330204.097147:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766102400 00000100:00100000:3.0:1788330204.097280:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 133 00000100:00100000:3.0:1788330204.097293:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+67:11409:x1875199766102400:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788330204.098259:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+67:11409:x1875199766102400:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 948us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330204.098274:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 133 00000100:00100000:2.0:1788330204.103015:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330204.103271:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766102528 00000100:00100000:0.0:1788330204.103353:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766102528 00000100:00100000:2.0:1788330204.103928:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 134 00000100:00100000:2.0:1788330204.103943:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+67:11409:x1875199766102528:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330204.103975:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330204.104009:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd17e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105fae expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.104114:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd17f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.104132:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd17f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.104147:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd17f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330204.104240:0:7832:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330204.104279:0:7832:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd17f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.104764:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd17e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fae expref: 69 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.104787:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd17f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fae expref: 68 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.104814:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99edc7580900) 00010000:00010000:2.0:1788330204.104818:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788330204.104823:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038c00, rc 0) 00000100:00100000:2.0:1788330204.104984:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+68:11409:x1875199766102528:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 1042us (1985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330204.104993:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 134 00000100:00100000:2.0:1788330204.109873:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330204.109974:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766102656 00000100:00100000:1.0:1788330204.109993:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766102656 00000100:00100000:1.0:1788330204.110083:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 46 00000100:00100000:1.0:1788330204.110099:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:2412:x1875199766102656:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330204.110130:0:8632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330204.110197:0:8632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd17f7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105fb5 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788330204.110258:0:8632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a97c0db, blocks: 0x0 00010000:00010000:1.0:1788330204.110291:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=408s v=(0 0) 00010000:00010000:1.0:1788330204.110296:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330204.110311:0:8632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd17f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fb5 expref: 10 pid: 8632 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.110334:0:8632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd17f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fb5 expref: 10 pid: 8632 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.110354:0:8632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79400, rc 0) 00000100:00100000:1.0:1788330204.110446:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+10:2412:x1875199766102656:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 350us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330204.110455:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 46 00000100:00100000:2.0:1788330204.115965:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330204.116072:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766102912 00000100:00100000:1.0:1788330204.116086:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766102912 00000100:00100000:1.0:1788330204.116198:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 135 00000100:00100000:1.0:1788330204.116210:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+68:11409:x1875199766102912:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788330204.116373:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+68:11409:x1875199766102912:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 165us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330204.116383:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 135 00000100:00100000:0.0:1788330204.121292:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330204.122084:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766103040 00000100:00100000:1.0:1788330204.122105:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766103040 00000100:00100000:1.0:1788330204.122235:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 47 00000100:00100000:1.0:1788330204.122259:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+10:11409:x1875199766103040:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330204.122309:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330204.122335:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd17fe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105fbc expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.122377:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd17f7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fb5 expref: 11 pid: 8632 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.122389:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330204.122394:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330204.122400:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd17fe lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fbc expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.122462:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd17f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fb5 expref: 11 pid: 8632 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.122479:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd17f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fb5 expref: 11 pid: 8632 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330204.122498:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f77b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1875199792393088:192.168.202.50@tcp:104: 00000100:00100000:1.0:1788330204.122995:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788330204.127494:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330204.127867:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f77b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1875199792393088:192.168.202.50@tcp:104: 00010000:00010000:1.0:1788330204.127920:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd17fe lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fbc expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.127949:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79600, rc 0) 00000100:00100000:1.0:1788330204.128057:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+11:11409:x1875199766103040:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 5809us (6790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330204.128069:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 47 00000100:00100000:3.0:1788330204.128269:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766103168 00000100:00100000:3.0:1788330204.128289:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766103168 00010000:00010000:3.0:1788330204.128336:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd17f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fb5 expref: 11 pid: 8632 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330204.128381:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 73 00000100:00100000:3.0:1788330204.128394:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec986c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+11:2413:x1875199766103168:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330204.128421:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330204.128461:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd17f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fb5 expref: 11 pid: 8632 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.128477:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd17f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fb5 expref: 11 pid: 8632 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.128519:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd17f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fb5 expref: 11 pid: 8632 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.128537:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330204.128542:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330204.128554:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd17fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fbc expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.128567:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd17fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fbc expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.128629:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd17fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fbc expref: 10 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330204.128649:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6508:1875199792393216:192.168.202.50@tcp:105: 00000100:00100000:3.0:1788330204.128980:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330204.133721:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6508:1875199792393216:192.168.202.50@tcp:105: 00010000:00010000:1.0:1788330204.133756:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330204.133830:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec986c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+10:2413:x1875199766103168:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 5438us (6352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330204.133845:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 73 00000100:00100000:0.0:1788330204.138549:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330204.138791:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766103296 00000100:00100000:3.0:1788330204.138806:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766103296 00002000:00100000:3.0:1788330204.138878:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff99edc7db0700 x1875199766103296/t0(0) o4->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:220/0 lens 504/0 e 0 to 0 dl 1788330215 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788330204.138907:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99edc7db0700 with x1875199766103296 ext(0->12) 00002000:00010000:3.0:1788330204.138915:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99edc7db0700 00000100:00100000:3.0:1788330204.138954:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:3.0:1788330204.138966:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+10:2412:x1875199766103296:12345-192.168.202.50@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788330204.140842:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+12:2412:x1875199766103296:12345-192.168.202.50@tcp:4:lhsmtool_posix.0 Request processed in 1861us (2292us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788330204.140859:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 2 00002000:00100000:3.0:1788330204.140875:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff99edc7db0700 x1875199766103296/t4294967309(0) o4->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:220/0 lens 504/448 e 0 to 0 dl 1788330215 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788330204.140887:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99edc7db0700 with x1875199766103296 ext(0->12) 00002000:00010000:3.0:1788330204.140894:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99edc7db0700 00000100:00100000:2.0:1788330204.144559:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330204.144952:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766103424 00000100:00100000:0.0:1788330204.144967:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766103424 00000100:00100000:0.0:1788330204.145051:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 136 00000100:00100000:0.0:1788330204.145064:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+68:11409:x1875199766103424:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788330204.150097:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1788330204.150147:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788330204.150203:0:6501:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99edc177a480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788330204.150209:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99edc75cc200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99edc177a6c0 00000020:00080000:3.0:1788330204.150213:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99edc75ccf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99edc72e2000 00000004:00080000:3.0:1788330204.150254:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788330204.150309:0:6501:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99edc665ce40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788330204.150313:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99edc661b200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99edc665ca80 00000020:00080000:3.0:1788330204.150315:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99edc661bf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99eefe489000 00000020:00080000:0.0:1788330204.150402:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1788330204.150515:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788330204.150740:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:11409:x1875199766103424:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 Request processed in 5669us (6188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330204.150752:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 136 00000100:00100000:0.0:1788330204.150918:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792393344:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788330204.150991:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330204.151059:0:13829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792393344 00000100:00100000:0.0:1788330204.151068:0:13829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792393344 00000100:00100000:0.0:1788330204.151129:0:13829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788330204.151139:0:13829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3648:x1875199792393344:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788330204.151201:0:13829:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:0.0:1788330204.151240:0:13829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1805 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.151282:0:13829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd15b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f14 expref: 11 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.151293:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788330204.151298:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788330204.151304:0:13829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1805 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.151340:0:13829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd15b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f14 expref: 11 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.151377:0:13829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd15b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f14 expref: 11 pid: 8632 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330204.151391:0:13829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13829:1875199792393472:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330204.151442:0:13829:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665c000 going to sleep for 11 seconds 00000100:00080000:0.0:1788330204.151457:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330204.152944:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330204.152971:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec3742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792393600:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788330204.153071:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330204.154974:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792393600 00000100:00100000:2.0:1788330204.154995:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792393600 00000100:00100000:2.0:1788330204.155101:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788330204.155118:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792393600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788330204.155201:0:8632:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:2.0:1788330204.155263:0:8632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a97c0db, atime: 0x6a97c0db, ctime: 0x6a97c0db, blocks: 0x8 00010000:00010000:2.0:1788330204.155276:0:8632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd180c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788330204.155374:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330204.157130:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00010000:00010000:2.0:1788330204.157337:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=408s v=(0 0) 00010000:00010000:2.0:1788330204.157342:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330204.157352:0:8632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd180c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.157374:0:8632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd180c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.157401:0:8632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd180c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.157410:0:8632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd180c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.157448:0:8632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788330204.158524:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1875199792393600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3405us (5446us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788330204.158539:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788330204.158573:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766103552 00000100:00100000:2.0:1788330204.158582:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766103552 00010000:00010000:3.0:1788330204.158670:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330204.158681:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd180c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.158693:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038a00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330204.158698:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd180c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.158709:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd180c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.158731:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd180c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.158738:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd180c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.158766:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330204.158768:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330204.158770:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330204.159315:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1503 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159326:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1503 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159334:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1503 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159340:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330204.159344:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1503 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159349:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1503 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159364:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff99eed0859100) 00010000:00010000:1.0:1788330204.159368:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330204.159372:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1503 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159379:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1503 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159431:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd15ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159437:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd15ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159444:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd15ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159448:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330204.159451:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd15ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159457:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd15ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159464:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff99eec91de200) 00010000:00010000:1.0:1788330204.159467:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330204.159470:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd15ab lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159476:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd15ab lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159490:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1629 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159496:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1629 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159509:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1629 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159519:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330204.159522:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1629 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159528:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1629 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159535:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eecbb95500) 00010000:00010000:1.0:1788330204.159537:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330204.159540:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1629 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159545:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1629 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159556:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd164c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159562:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd164c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159568:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd164c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159580:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330204.159583:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd164c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159588:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd164c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159605:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eecbb95500) 00010000:00010000:1.0:1788330204.159608:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330204.159610:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd164c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159616:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd164c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159631:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd171e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159636:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd171e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159642:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd171e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159647:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330204.159650:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd171e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.159656:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd171e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330204.161071:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788330204.161085:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967304 00000004:00080000:3.0:1788330204.161122:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99eeffd68380, transno 4294967302 00000004:00080000:3.0:1788330204.161141:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967304 00000100:00100000:3.0:1788330204.161181:0:3648:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff99eec3742300 x1875199792393600/t4294967305(4294967305) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788330220 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788330204.161215:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99eec3742300/2, rc 0, transno 4294967305 00000100:00100000:3.0:1788330204.161222:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec3742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792393600:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788330204.162026:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:1.0:1788330204.162035:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330204.162049:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd171e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.162062:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd171e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.162114:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd17db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.162122:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd17db lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.162130:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd17db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.162137:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330204.162142:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd17db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.162170:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd17db lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.162192:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99edc7580900) 00010000:00010000:1.0:1788330204.162195:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788330204.162199:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd17db lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.162205:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd17db lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330204.162910:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 50 00000100:00100000:0.0:1788330204.162933:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+12:2412:x1875199766103552:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788330204.166235:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1788330204.166275:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:2.0:1788330204.167201:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330204.167427:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766103680 00000100:00100000:1.0:1788330204.167439:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766103680 00010000:00010000:1.0:1788330204.167492:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd15b9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f14 expref: 8 pid: 8632 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330204.167562:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 74 00000100:00100000:1.0:1788330204.167598:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2413:x1875199766103680:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330204.167620:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330204.167627:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd15b9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f14 expref: 8 pid: 8632 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.167645:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd15b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f14 expref: 8 pid: 8632 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.167692:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330204.167698:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330204.167707:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1805 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.167719:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1805 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.167746:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330204.167828:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2413:x1875199766103680:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 232us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330204.167837:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 74 00010000:00010000:1.0:1788330204.167909:0:13829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a472155f/0x8475908e9fd15b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f14 expref: 7 pid: 8632 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330204.167927:0:13829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13829:1875199792393472:192.168.202.50@tcp:104: 00010000:00010000:1.0:1788330204.167950:0:13829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1805 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.167976:0:13829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1805 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.167984:0:13829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1805 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.167996:0:13829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1805 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.168006:0:13829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1805 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.168027:0:13829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330204.169870:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330204.169889:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1805 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.169906:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330204.169911:0:10341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1805 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.169925:0:10341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1805 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.169953:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1805 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.169981:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1805 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.170014:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330204.170016:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330204.170018:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330204.172267:0:13829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6605c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3648:x1875199792393344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21106us (21253us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788330204.172416:0:13829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788330204.172822:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1788330204.172830:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1788330204.172862:0:3648:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff99edc7db1c00 x1875199792393344/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788330220 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788330204.172877:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99edc7db1c00/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788330204.172903:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792393344:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788330204.173191:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2412:x1875199766103552:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 Request processed in 10263us (16067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330204.173204:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 50 00000100:00100000:2.0:1788330204.178862:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330204.179071:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766103936 00000100:00100000:3.0:1788330204.179085:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766103936 00000100:00100000:3.0:1788330204.179234:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 137 00000100:00100000:3.0:1788330204.179259:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+16:11409:x1875199766103936:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788330204.179350:0:7832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330204.179390:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd17f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fae expref: 16 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.179496:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99edc7580900) 00010000:00010000:3.0:1788330204.179509:0:7832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330204.179555:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1813 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.179572:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1813 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.179594:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1813 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330204.179981:0:7832:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cdae2051 reply state 000000000eb798b1 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1813 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.179999:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1813 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.180006:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99edc7580900) 00010000:00010000:3.0:1788330204.180009:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788330204.180012:0:7832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788330204.180390:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+17:11409:x1875199766103936:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 1142us (1546us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1788330204.180402:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 137 00000100:00100000:0.0:1788330204.185077:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330204.185439:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766104064 00000100:00100000:3.0:1788330204.185454:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766104064 00000100:00100000:3.0:1788330204.185528:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:3.0:1788330204.185541:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2413:x1875199766104064:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788330204.186058:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788330204.186063:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788330203 00002000:00010000:3.0:1788330204.186066:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788330203 00002000:00010000:3.0:1788330204.186068:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788330203 -> 1788330203 00002000:00010000:3.0:1788330204.186071:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788330204.186257:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2413:x1875199766104064:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 708us (1189us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788330204.186267:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:0.0:1788330204.190860:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330204.190965:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766104320 00000100:00100000:3.0:1788330204.190979:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766104320 00000100:00100000:3.0:1788330204.191103:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 138 00000100:00100000:3.0:1788330204.191134:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+17:11409:x1875199766104320:12345-192.168.202.50@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788330204.191296:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd181a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.191318:0:12916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd17d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fa0 expref: 17 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.191330:0:12916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd181a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.191382:0:12916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd17d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fa0 expref: 17 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.191400:0:12916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd17d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fa0 expref: 17 pid: 12916 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330204.191428:0:12916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6605500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792393728:192.168.202.50@tcp:104: 00000100:00100000:3.0:1788330204.191553:0:12916:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788330204.196434:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330204.196822:0:13195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766104448 00000100:00100000:1.0:1788330204.196834:0:13195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766104448 00010000:00010000:1.0:1788330204.196894:0:13195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd17d4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fa0 expref: 18 pid: 12916 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330204.196949:0:13195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 75 00000100:00100000:1.0:1788330204.196962:0:13195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:2412:x1875199766104448:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330204.196981:0:13195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330204.196989:0:13195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd17d4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fa0 expref: 18 pid: 12916 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.197020:0:13195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd17d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fa0 expref: 18 pid: 12916 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.197055:0:13195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99edc7580900) 00010000:00010000:1.0:1788330204.197062:0:13195:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd181a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.197074:0:13195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd181a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.197082:0:13195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd181a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.197107:0:13195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330204.197229:0:13195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:2412:x1875199766104448:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 268us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330204.197237:0:13195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 75 00010000:00010000:3.0:1788330204.200030:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd17d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fa0 expref: 17 pid: 12916 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330204.200062:0:12916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6605500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792393728:192.168.202.50@tcp:104: 00010000:00010000:3.0:1788330204.200106:0:12916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd181a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.200386:0:12916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd181a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.200394:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd181a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.200797:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd181a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.200805:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd181a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.200814:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd181a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.200820:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330204.200825:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd181a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.200833:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd181a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.200855:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99edc7580900) 00010000:00010000:2.0:1788330204.200878:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788330204.200886:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd181a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.200892:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd181a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330204.201062:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+16:11409:x1875199766104320:12345-192.168.202.50@tcp:55:lhsmtool_posix.0 Request processed in 9928us (10218us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788330204.201075:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 138 00000100:00100000:0.0:1788330204.207746:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330204.207844:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766104576 00000100:00100000:2.0:1788330204.207858:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766104576 00000100:00100000:2.0:1788330204.207979:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:2.0:1788330204.207992:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2412:x1875199766104576:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788330204.208054:0:8632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000562516b0/0x8475908e9fd1821 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.208084:0:8632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd17fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fbc expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.208094:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330204.208099:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788330204.208104:0:8632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000562516b0/0x8475908e9fd1821 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.208194:0:8632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd17fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fbc expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.208234:0:8632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd17fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fbc expref: 7 pid: 8439 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330204.208264:0:8632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec977b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8632:1875199792393856:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330204.208393:0:8632:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc764b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788330204.211632:0:8632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec977b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8632:1875199792393856:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330204.211808:0:8632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000562516b0/0x8475908e9fd1821 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330204.217257:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330204.218086:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766104704 00000100:00100000:1.0:1788330204.218104:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766104704 00010000:00010000:1.0:1788330204.218204:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd17fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fbc expref: 8 pid: 8439 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330204.218272:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 76 00000100:00100000:1.0:1788330204.218284:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2412:x1875199766104704:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330204.218315:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330204.218343:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd17fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fbc expref: 8 pid: 8439 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.218381:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd17fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fbc expref: 8 pid: 8439 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.218421:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd17fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fbc expref: 8 pid: 8439 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.218816:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330204.218881:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330204.218889:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000562516b0/0x8475908e9fd1821 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.218900:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000562516b0/0x8475908e9fd1821 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.219017:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330204.219112:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2412:x1875199766104704:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 828us (2699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330204.219122:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 76 00010000:00010000:3.0:1788330204.226907:0:8632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000562516b0/0x8475908e9fd1821 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.226962:0:8632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000562516b0/0x8475908e9fd1821 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.227007:0:8632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000562516b0/0x8475908e9fd1821 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.227016:0:8632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000562516b0/0x8475908e9fd1821 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.227026:0:8632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000562516b0/0x8475908e9fd1821 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.227033:0:8632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039600 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330204.227039:0:8632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000562516b0/0x8475908e9fd1821 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.227049:0:8632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000562516b0/0x8475908e9fd1821 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.227075:0:8632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000562516b0/0x8475908e9fd1821 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.227083:0:8632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000562516b0/0x8475908e9fd1821 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330204.228137:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2412:x1875199766104576:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 Request processed in 20131us (20466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330204.228184:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:0.0:1788330204.234551:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330204.235050:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766104960 00000100:00100000:2.0:1788330204.235065:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766104960 00000100:00100000:1.0:1788330204.238403:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 139 00000100:00100000:1.0:1788330204.238459:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+16:11409:x1875199766104960:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788330204.238604:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1828 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.238632:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1717 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f68 expref: 16 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.238673:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1828 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.238736:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1717 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f68 expref: 16 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.240825:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1717 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f68 expref: 16 pid: 12916 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330204.240860:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1875199792393984:192.168.202.50@tcp:104: 00000100:00100000:1.0:1788330204.241043:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788330204.246364:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330204.246932:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766105088 00000100:00100000:2.0:1788330204.246946:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766105088 00010000:00010000:2.0:1788330204.247010:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1717 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f68 expref: 17 pid: 12916 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330204.247072:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 77 00000100:00100000:2.0:1788330204.247085:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+17:2413:x1875199766105088:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330204.247103:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330204.247110:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1717 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f68 expref: 17 pid: 12916 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.247145:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1717 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f68 expref: 17 pid: 12916 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.247208:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:2.0:1788330204.247217:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd1779 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f8b expref: 17 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.247230:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1828 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.247239:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1828 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.247258:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1828 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.247297:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330204.247372:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+17:2413:x1875199766105088:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 289us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330204.247379:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 77 00010000:00010000:3.0:1788330204.249142:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1717 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f68 expref: 16 pid: 12916 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330204.249226:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f77b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1875199792393984:192.168.202.50@tcp:104: 00010000:00010000:3.0:1788330204.249269:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1828 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.249291:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1828 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.249886:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1828 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.250138:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd182f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.250202:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd17e2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fa7 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.250212:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd182f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.250273:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd17e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fa7 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.250290:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd17e2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fa7 expref: 16 pid: 6523 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330204.253009:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6605500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1875199792394112:192.168.202.50@tcp:104: 00000100:00100000:3.0:1788330204.253185:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788330204.263509:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330204.263590:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6605500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1875199792394112:192.168.202.50@tcp:104: 00010000:00010000:3.0:1788330204.263650:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd182f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330204.266982:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766105216 00000100:00100000:2.0:1788330204.267006:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766105216 00010000:00010000:2.0:1788330204.267080:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd17e2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fa7 expref: 17 pid: 6523 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330204.267229:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 78 00000100:00100000:2.0:1788330204.267242:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+17:2413:x1875199766105216:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330204.267312:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330204.267322:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd17e2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fa7 expref: 17 pid: 6523 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.267339:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd17e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fa7 expref: 17 pid: 6523 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.267371:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd17e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fa7 expref: 17 pid: 6523 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.267392:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99edc7580900) 00010000:00010000:2.0:1788330204.267399:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd182f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.267424:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd182f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.267440:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd182f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.267477:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330204.268106:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd182f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330204.268119:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd182f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788330204.268335:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1788330204.268874:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:3.0:1788330204.268927:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1788330204.269048:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6605500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6523:1875199792394240:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788330204.269211:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330204.269295:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792394240 00000100:00100000:3.0:1788330204.269305:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792394240 00000100:00100000:3.0:1788330204.269368:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788330204.269380:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6523:x1875199792394240:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788330204.270094:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:2413:x1875199766105216:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 2843us (6581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330204.270110:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 78 00000100:00100000:3.0:1788330204.270845:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6523:x1875199792394240:12345-0@lo:1000:mdt00_001.0 Request processed in 1460us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330204.270859:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788330204.270906:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330204.270955:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6605500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6523:1875199792394240:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788330204.271253:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:3.0:1788330204.271372:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6605500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6523:1875199792394368:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788330204.271452:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330204.271488:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788330204.271954:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792394368 00000100:00100000:0.0:1788330204.271967:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792394368 00000100:00100000:0.0:1788330204.272036:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788330204.272049:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1875199792394368:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788330204.272349:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6523:x1875199792394368:12345-0@lo:1000:mdt00_001.0 Request processed in 301us (896us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788330204.272358:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788330204.272437:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6605500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6523:1875199792394368:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788330204.272500:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd182f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.272513:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd182f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.272521:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd182f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.272529:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59ca000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330204.272534:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd182f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.272542:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd182f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.272566:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99edc7580900) 00010000:00010000:0.0:1788330204.272570:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788330204.272718:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd182f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.272814:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd182f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.272853:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1772 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.272874:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1772 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.272881:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1772 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.272886:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330204.272889:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1772 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.272895:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1772 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.272904:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:0.0:1788330204.272907:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788330204.272917:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd1779 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f8b expref: 19 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.272929:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd1779 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f8b expref: 19 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.272938:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd1779 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f8b expref: 19 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.272981:0:6523:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd1779 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f8b expref: 19 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330204.272996:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7ef2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1875199792394496:192.168.202.50@tcp:105: 00000100:00100000:0.0:1788330204.273090:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788330204.278552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330204.278640:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7ef2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1875199792394496:192.168.202.50@tcp:105: 00010000:00010000:0.0:1788330204.278687:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1772 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.278700:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1772 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.278966:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1836 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.278986:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1836 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.278999:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1836 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.279013:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1836 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.279019:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1836 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.279025:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1836 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.279030:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330204.279035:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1836 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.279042:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1836 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.279074:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:0.0:1788330204.279077:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330204.279083:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1836 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.279089:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1836 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.279102:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1828 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.279108:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1828 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.279114:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1828 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.279119:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330204.279123:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1828 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.279129:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1828 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.279137:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:0.0:1788330204.279139:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788330204.279142:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1828 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.279148:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1828 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788330204.281123:0:13809:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788330204.281139:0:13809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1788330204.281491:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766105344 00000100:00100000:1.0:1788330204.281507:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766105344 00000100:00100000:1.0:1788330204.281856:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:1.0:1788330204.281870:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+20:11408:x1875199766105344:12345-192.168.202.50@tcp:49:lfs.0 00000100:00100000:1.0:1788330204.282067:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+20:11408:x1875199766105344:12345-192.168.202.50@tcp:49:lfs.0 Request processed in 200us (3529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330204.282076:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:1.0:1788330204.284223:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:11409:x1875199766104960:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 45774us (49668us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788330204.284254:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 139 00000020:00080000:1.0:1788330204.284264:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788330204.285044:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788330204.285066:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788330204.290227:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330204.290972:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766105600 00000100:00100000:1.0:1788330204.290989:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766105600 00000100:00100000:1.0:1788330204.291076:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:1.0:1788330204.291089:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9241850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:11409:x1875199766105600:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788330204.292030:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788330204.292072:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1788330204.292109:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd183d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.292129:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd183d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.292142:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd183d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.292181:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd183d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.292188:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd183d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.292195:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd183d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.292210:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330204.292975:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330204.292988:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd183d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.292998:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79e00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330204.293003:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd183d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.293013:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd183d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.293031:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99edc7580900) 00010000:00010000:0.0:1788330204.293034:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788330204.293039:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd183d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.293045:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd183d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330204.293063:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330204.293064:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330204.293066:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330204.293371:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9241850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:11409:x1875199766105600:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 2276us (3156us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788330204.293383:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 32 00000020:00080000:1.0:1788330204.293391:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788330204.299446:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330204.300618:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766105856 00000100:00100000:3.0:1788330204.300637:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766105856 00000100:00100000:3.0:1788330204.300744:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 140 00000100:00100000:3.0:1788330204.300760:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:11408:x1875199766105856:12345-192.168.202.50@tcp:58:lfs.0 00000040:00080000:3.0:1788330204.301027:0:7832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788330204.301195:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:11408:x1875199766105856:12345-192.168.202.50@tcp:58:lfs.0 Request processed in 438us (1764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330204.301204:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 140 00000100:00100000:0.0:1788330204.359845:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330204.360098:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766105984 00000100:00100000:2.0:1788330204.360114:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766105984 00000100:00100000:2.0:1788330204.360229:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 141 00000100:00100000:2.0:1788330204.360253:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:11411:x1875199766105984:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330204.360320:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330204.360350:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1844 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105fc3 expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.360443:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd184b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.360461:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd184b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.360476:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd184b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.360510:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1852 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.360518:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1852 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.360525:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1852 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.360631:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1859 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.360642:0:12916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1764 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f84 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.360650:0:12916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1859 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.360857:0:12916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1764 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f84 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.360901:0:12916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1764 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f84 expref: 22 pid: 6524 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330204.360918:0:12916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec977b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792394624:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330204.361122:0:12916:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc764b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788330204.369679:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330204.370053:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766106240 00000100:00100000:3.0:1788330204.370067:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766106240 00000100:00100000:3.0:1788330204.370145:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:3.0:1788330204.370191:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+23:6185:x1875199766106240:12345-192.168.202.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788330204.370546:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+24:6185:x1875199766106240:12345-192.168.202.50@tcp:35:ldlm_bl.0 Request processed in 357us (887us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788330204.370556:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:0.0:1788330204.379020:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330204.379205:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766106368 00000100:00100000:1.0:1788330204.379220:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766106368 00010000:00010000:1.0:1788330204.379299:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1764 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f84 expref: 24 pid: 6524 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330204.379345:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 79 00000100:00100000:1.0:1788330204.379377:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+24:2412:x1875199766106368:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330204.379396:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330204.379414:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1764 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f84 expref: 24 pid: 6524 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.380352:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1764 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f84 expref: 24 pid: 6524 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.380388:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:1.0:1788330204.380393:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1859 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.380938:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.380951:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1859 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330204.380992:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330204.382777:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+24:2412:x1875199766106368:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 1720us (2091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330204.382803:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 79 00010000:00010000:2.0:1788330204.385108:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1764 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f84 expref: 23 pid: 6524 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330204.385139:0:12916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec977b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792394624:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330204.385214:0:12916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.385227:0:12916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.385233:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330204.385334:0:12916:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788330204.385339:0:12916:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330204.385371:0:12916:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.385390:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.385402:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd184b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.385447:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd184b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.385455:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd184b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.385468:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330204.385472:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd184b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.385480:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd184b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.385500:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:2.0:1788330204.385504:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330204.385509:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd184b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.385521:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd184b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.385534:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1852 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.385540:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1852 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.385545:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1852 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.385550:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330204.385557:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1852 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.385563:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1852 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.385570:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff99eecbb95800) 00010000:00010000:2.0:1788330204.385813:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330204.385819:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1852 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.385825:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1852 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.385879:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1844 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fc3 expref: 23 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.385894:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1859 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fc3 expref: 22 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330204.385901:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:2.0:1788330204.385903:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330204.385906:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039600, rc 0) 00000100:00100000:2.0:1788330204.386000:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:11411:x1875199766105984:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 25760us (26172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330204.386010:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 141 00000100:00100000:1.0:1788330204.572332:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330204.572373:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792394752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330204.572727:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330204.572920:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792394752 00000100:00100000:0.0:1788330204.572931:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792394752 00000100:00100000:0.0:1788330204.572998:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788330204.573010:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792394752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330204.573056:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788330204.573115:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792394752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330204.573123:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788330204.573829:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792394752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330204.574438:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792394880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788330204.574511:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330204.574788:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792394880 00000100:00100000:1.0:1788330204.574796:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792394880 00000100:00100000:1.0:1788330204.574886:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788330204.574895:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792394880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788330204.574918:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1788330204.574969:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792394880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330204.574975:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788330204.575021:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792394880:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788330204.575127:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330204.579818:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792395008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330204.579926:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788330204.580045:0:9991:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 408551892778ns, next at 409551888938ns, rc = 0 00000100:00100000:1.0:1788330204.580800:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792395008 00000100:00100000:1.0:1788330204.580815:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792395008 00000100:00100000:1.0:1788330204.580885:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788330204.580897:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875199792395008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330204.580932:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1788330204.586860:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875199792395008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5947us (6917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330204.586880:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788330204.593170:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792395008:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788330205.084354:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788330205.341727:0:13809:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788330205.341741:0:13809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788330205.341794:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788330205.341803:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788330205.341979:0:13809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7efed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13809:1875199792395136:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788330205.342096:0:13809:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330205.349656:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330205.350376:0:13809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7efed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13809:1875199792395136:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788330205.350523:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766106496 00000100:00100000:1.0:1788330205.350536:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766106496 00000100:00100000:1.0:1788330205.350692:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 142 00000100:00100000:1.0:1788330205.350705:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+23:11422:x1875199766106496:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788330205.350758:0:6523:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788330205.350932:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+23:11422:x1875199766106496:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 229us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330205.350941:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 142 00000100:00080000:0.0:1788330205.351205:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330205.361593:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330205.361652:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766106752 00000100:00100000:0.0:1788330205.361668:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766106752 00000100:00100000:0.0:1788330205.361753:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 143 00000100:00100000:0.0:1788330205.361767:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:11422:x1875199766106752:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330205.361811:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330205.361841:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1860 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105fca expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330205.361994:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1867 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330205.362015:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1867 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330205.362030:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1867 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330205.362045:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788330205.362229:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1860 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fca expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330205.362263:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1867 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fca expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330205.362283:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:0.0:1788330205.362286:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330205.362291:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327e00, rc 0) 00000100:00100000:0.0:1788330205.362367:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+24:11422:x1875199766106752:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 602us (791us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788330205.362375:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 143 00000100:00100000:0.0:1788330205.374619:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330205.374789:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766107008 00000100:00100000:2.0:1788330205.374805:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766107008 00000100:00100000:2.0:1788330205.374910:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 144 00000100:00100000:2.0:1788330205.374922:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+24:11422:x1875199766107008:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788330205.375038:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1875 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330205.375061:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1875 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330205.375075:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1875 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330205.375445:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1875 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330205.375455:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1875 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330205.375463:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1875 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330205.375470:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330205.375476:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1875 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330205.375485:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1875 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330205.375502:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:2.0:1788330205.375505:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788330205.375511:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1875 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330205.375530:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1875 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330205.375797:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+25:11422:x1875199766107008:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 875us (1194us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788330205.375807:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 144 00000100:00100000:3.0:1788330205.378945:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330205.379917:0:13195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766107136 00000100:00100000:2.0:1788330205.379934:0:13195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766107136 00000100:00100000:2.0:1788330205.380032:0:13195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:2.0:1788330205.380046:0:13195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec986c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+25:2410:x1875199766107136:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330205.380065:0:13195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330205.380100:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1867 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fca expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330205.380125:0:13195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:2.0:1788330205.380132:0:13195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330205.380251:0:13195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec986c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+24:2410:x1875199766107136:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 208us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330205.380259:0:13195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:3.0:1788330205.382825:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330205.383029:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766107392 00000100:00100000:2.0:1788330205.383043:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766107392 00000100:00100000:2.0:1788330205.383122:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:2.0:1788330205.383133:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+24:11422:x1875199766107392:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788330205.383492:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+25:11422:x1875199766107392:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 360us (684us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788330205.383522:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 34 00000040:00080000:0.0:1788330205.384135:0:13809:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788330205.384142:0:13809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788330205.384927:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788330205.384944:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788330205.430989:0:14273:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788330205.431004:0:14273:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788330205.431057:0:14273:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788330205.431065:0:14273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788330205.624562:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330205.624650:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766107648 00000100:00100000:3.0:1788330205.624665:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766107648 00000100:00100000:3.0:1788330205.624775:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 145 00000100:00100000:3.0:1788330205.624789:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+25:11435:x1875199766107648:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:3.0:1788330205.624827:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330205.624860:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd187c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105fd1 expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330205.625030:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd1883 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330205.625049:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd1883 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330205.625062:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd1883 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330205.625074:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788330205.625279:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd187c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fd1 expref: 28 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330205.625302:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd1883 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fd1 expref: 27 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330205.625311:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:3.0:1788330205.625315:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788330205.625320:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59ca200, rc 0) 00000100:00100000:3.0:1788330205.625402:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+27:11435:x1875199766107648:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 616us (858us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788330205.625408:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 145 00000100:00100000:0.0:1788330205.641982:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330205.642137:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766107776 00000100:00100000:1.0:1788330205.642378:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766107776 00000100:00100000:1.0:1788330205.642462:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 146 00000100:00100000:1.0:1788330205.642484:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+27:11435:x1875199766107776:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:1.0:1788330205.642662:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1891 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330205.642685:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1891 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330205.642849:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1891 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330205.642903:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1891 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330205.642912:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1891 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330205.642921:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1891 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330205.642928:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330205.642934:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1891 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330205.642943:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1891 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330205.643634:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:1.0:1788330205.643641:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788330205.643651:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1891 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330205.643659:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd1891 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330205.644096:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+27:11435:x1875199766107776:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 1607us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330205.644109:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 146 00000100:00100000:0.0:1788330205.792645:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330205.793278:0:13829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766107904 00000100:00100000:1.0:1788330205.793303:0:13829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766107904 00000100:00100000:1.0:1788330205.793602:0:13829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:1.0:1788330205.793617:0:13829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2410:x1875199766107904:12345-192.168.202.50@tcp:101:cat.0 00010000:00010000:1.0:1788330205.793646:0:13829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330205.793677:0:13829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8d068c7/0x8475908e9fd1898 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105fd8 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788330205.793713:0:13829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a97c0db, atime: 0x6a97c0db, ctime: 0x6a97c0db, blocks: 0x8 00010000:00010000:1.0:1788330205.793741:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=409s v=(0 0) 00010000:00010000:1.0:1788330205.793747:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330205.793760:0:13829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8d068c7/0x8475908e9fd1898 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fd8 expref: 7 pid: 13829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330205.793784:0:13829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8d068c7/0x8475908e9fd1898 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fd8 expref: 7 pid: 13829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330205.793803:0:13829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78200, rc 0) 00000100:00100000:1.0:1788330205.793900:0:13829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2410:x1875199766107904:12345-192.168.202.50@tcp:101:cat.0 Request processed in 286us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330205.793907:0:13829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:1.0:1788330205.801212:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330205.801747:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766108032 00000100:00100000:3.0:1788330205.801776:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766108032 00002000:00100000:3.0:1788330205.801853:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff99edc7f74380 x1875199766108032/t0(0) o3->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:221/0 lens 488/0 e 0 to 0 dl 1788330216 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788330205.801866:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99edc7f74380 with x1875199766108032 ext(0->4095) 00002000:00010000:3.0:1788330205.801874:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99edc7f74380 00000100:00100000:3.0:1788330205.801917:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:3.0:1788330205.801931:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2411:x1875199766108032:12345-192.168.202.50@tcp:3:cat.0 00000100:00100000:3.0:1788330205.802247:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2411:x1875199766108032:12345-192.168.202.50@tcp:3:cat.0 Request processed in 316us (1115us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788330205.802256:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 3 00002000:00100000:3.0:1788330205.802264:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff99edc7f74380 x1875199766108032/t0(0) o3->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:221/0 lens 488/4536 e 0 to 0 dl 1788330216 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788330205.802274:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99edc7f74380 with x1875199766108032 ext(0->4095) 00002000:00010000:3.0:1788330205.802278:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99edc7f74380 00010000:00010000:2.0:1788330206.107538:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330206.107689:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec977a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792395264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330206.107813:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330206.108013:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792395264 00000100:00100000:1.0:1788330206.108026:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792395264 00000100:00100000:0.0:1788330206.108114:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330206.108117:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788330206.108125:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792395392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330206.108130:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875199792395264:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330206.108183:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788330206.108198:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330206.108218:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792395392 00000100:00100000:0.0:1788330206.108222:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792395392 00000100:00100000:0.0:1788330206.108256:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788330206.108262:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef7069c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792395392:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330206.108267:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875199792395264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (456us total) trans 0 rc 0/0 00002000:00000024:0.0:1788330206.108273:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330206.108275:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788330206.108303:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef7069c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792395392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330206.108309:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788330206.108334:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec977a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792395264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330206.108372:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792395392:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788330206.108482:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330207.131624:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6e49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792395520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330207.131736:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330207.133454:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330207.133594:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792395520 00000100:00100000:3.0:1788330207.133612:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792395520 00000100:00100000:3.0:1788330207.133713:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788330207.133730:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792395520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788330207.133803:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788330207.133977:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792395520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 251us (2240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330207.133987:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788330207.134417:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6e49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792395520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788330207.646739:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec977aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792395648:0@lo:400:kworker.0 00000100:00100000:2.0:1788330207.646853:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330207.646909:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec9779f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792396160:0@lo:400:kworker.0 00000100:00100000:2.0:1788330207.646940:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330207.646963:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec977a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792396672:0@lo:400:kworker.0 00000100:00100000:2.0:1788330207.646987:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330207.647030:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788330207.647036:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec977ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792395776:0@lo:400:kworker.0 00000100:00100000:2.0:1788330207.647061:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330207.647081:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec9779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792396288:0@lo:400:kworker.0 00000100:00100000:2.0:1788330207.647134:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330207.647177:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792396800:0@lo:400:kworker.0 00000100:00100000:2.0:1788330207.647199:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330207.647246:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec9779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792395904:0@lo:400:kworker.0 00000100:00100000:1.0:1788330207.647906:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792396160 00000100:00100000:1.0:1788330207.647921:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792396160 00000100:00100000:1.0:1788330207.648001:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792396672 00000100:00100000:1.0:1788330207.648004:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792396672 00000100:00100000:1.0:1788330207.648023:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792395776 00000100:00100000:1.0:1788330207.648026:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792395776 00000100:00100000:1.0:1788330207.648038:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792396288 00000100:00100000:1.0:1788330207.648040:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792396288 00000100:00100000:1.0:1788330207.648060:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788330207.648072:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792396160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330207.648183:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792396160:12345-0@lo:400:kworker.0 Request processed in 112us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330207.648193:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788330207.648220:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792396800 00000100:00100000:1.0:1788330207.648225:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792396800 00000100:00100000:1.0:1788330207.648244:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788330207.649746:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330207.649802:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec9779880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792396416:0@lo:400:kworker.0 00000100:00100000:2.0:1788330207.649833:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330207.649857:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792396928:0@lo:400:kworker.0 00000100:00100000:2.0:1788330207.649876:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330207.649906:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788330207.649913:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec977bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792396032:0@lo:400:kworker.0 00000100:00100000:2.0:1788330207.649937:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330207.649961:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec977b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792396544:0@lo:400:kworker.0 00000100:00100000:2.0:1788330207.649985:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330207.650005:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec12ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792397056:0@lo:400:kworker.0 00000100:00100000:2.0:1788330207.650028:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330207.650081:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792395648 00000100:00100000:2.0:1788330207.650090:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792395648 00000100:00100000:1.0:1788330207.650718:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792396672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330207.650814:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792396672:12345-0@lo:400:kworker.0 Request processed in 2562us (3824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330207.650825:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788330207.650856:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792395904 00000100:00100000:1.0:1788330207.650861:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792395904 00000100:00100000:1.0:1788330207.650888:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788330207.650898:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792395776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330207.650931:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792395776:12345-0@lo:400:kworker.0 Request processed in 35us (3869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330207.650937:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788330207.650951:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788330207.650960:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792396288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330207.650996:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792396288:12345-0@lo:400:kworker.0 Request processed in 39us (3861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330207.651002:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788330207.651014:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788330207.651021:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792396800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330207.651053:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792396800:12345-0@lo:400:kworker.0 Request processed in 33us (3853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330207.651060:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788330207.651072:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788330207.651079:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792395904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330207.651122:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792395904:12345-0@lo:400:kworker.0 Request processed in 44us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330207.651129:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00080000:1.0:1788330207.651174:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788330207.651181:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330207.651196:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792396032 00000100:00100000:1.0:1788330207.651201:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792396032 00000100:00100000:0.0:1788330207.655658:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec977ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792395776:0@lo:400:kworker.0 00010000:00080000:0.0:1788330207.655694:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec9779180 x1875199792396288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330207.655708:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec9779180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792396288:0@lo:400:kworker.0 00010000:00080000:0.0:1788330207.655725:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec12eb800 x1875199792396800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330207.655758:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792396800:0@lo:400:kworker.0 00000100:00100000:0.0:1788330207.655777:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec9779f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792396160:0@lo:400:kworker.0 00000100:00100000:0.0:1788330207.655791:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec977a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792396672:0@lo:400:kworker.0 00000100:00100000:1.0:1788330207.657539:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788330207.657575:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792396032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330207.657748:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792396032:12345-0@lo:400:kworker.0 Request processed in 192us (7808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330207.657755:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788330207.662465:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1788330207.662559:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792396416 00000100:00100000:2.0:1788330207.662572:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792396416 00000100:00100000:2.0:1788330207.662652:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792396928 00000100:00100000:2.0:1788330207.662657:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792396928 00000100:00100000:2.0:1788330207.662690:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792396544 00000100:00100000:2.0:1788330207.662694:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792396544 00000100:00100000:2.0:1788330207.662707:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792397056 00000100:00100000:2.0:1788330207.662710:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792397056 00000100:00100000:2.0:1788330207.662733:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788330207.662743:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792396416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330207.662952:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788330207.662963:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792396928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330207.662999:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792396928:12345-0@lo:400:kworker.0 Request processed in 41us (13122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330207.663005:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788330207.663025:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788330207.663030:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792396544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330207.663052:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792396544:12345-0@lo:400:kworker.0 Request processed in 22us (13067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330207.663057:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788330207.663066:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788330207.663071:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3646:x1875199792397056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330207.663091:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3646:x1875199792397056:12345-0@lo:400:kworker.0 Request processed in 20us (13063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330207.663096:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1788330207.663112:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788330207.663142:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792396416:12345-0@lo:400:kworker.0 Request processed in 185us (13090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330207.663175:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788330207.664422:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec977bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792396032:0@lo:400:kworker.0 00000100:00100000:2.0:1788330207.664467:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec977b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792396544:0@lo:400:kworker.0 00000100:00100000:2.0:1788330207.664482:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792397056:0@lo:400:kworker.0 00000100:00100000:2.0:1788330207.665044:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec9779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792395904:0@lo:400:kworker.0 00000100:00100000:2.0:1788330207.665058:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec9779880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792396416:0@lo:400:kworker.0 00000100:00100000:2.0:1788330207.665071:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec12ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792396928:0@lo:400:kworker.0 00000100:00100000:2.0:1788330207.666350:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00bea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3648:x1875199792395648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330207.666483:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00bea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3648:x1875199792395648:12345-0@lo:400:kworker.0 Request processed in 3984us (19630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330207.666508:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788330207.678109:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec977aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792395648:0@lo:400:kworker.0 00000100:00100000:2.0:1788330207.980121:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330207.980408:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330207.980456:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330207.981429:0:13409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766108544 00000100:00100000:0.0:1788330207.981445:0:13409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766108544 00000100:00100000:0.0:1788330207.981568:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 136 00000100:00100000:0.0:1788330207.981582:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766108544:12345-192.168.202.50@tcp:400:kworker.0 00000100:00080000:3.0:1788330207.981610:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330207.981704:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766108544:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 124us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330207.981713:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 136 00000100:00100000:2.0:1788330207.994442:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330207.994486:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330207.994597:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766108160 00000100:00100000:3.0:1788330207.994612:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766108160 00000100:00100000:3.0:1788330207.994683:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 389 00000100:00100000:3.0:1788330207.994712:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00bea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2411:x1875199766108160:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330207.994812:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00bea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2411:x1875199766108160:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 103us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330207.994820:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 389 00000100:00100000:1.0:1788330207.996679:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766108288 00000100:00100000:1.0:1788330207.996701:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766108288 00000100:00100000:1.0:1788330207.996873:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766108800 00000100:00100000:1.0:1788330207.996878:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766108800 00000100:00100000:1.0:1788330207.996910:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 326 00000100:00100000:1.0:1788330207.996920:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+27:2411:x1875199766108288:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330207.997011:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+27:2411:x1875199766108288:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 91us (16907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330207.997019:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 326 00000100:00100000:1.0:1788330207.997038:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 327 00000100:00100000:1.0:1788330207.997045:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefe7ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766108800:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330207.997073:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefe7ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766108800:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 28us (16617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330207.997079:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 327 00000100:00080000:1.0:1788330207.997120:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330208.001532:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330208.001580:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330208.001957:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766108416 00000100:00100000:3.0:1788330208.001972:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766108416 00000100:00100000:3.0:1788330208.002063:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766108928 00000100:00100000:3.0:1788330208.002067:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766108928 00000100:00100000:3.0:1788330208.002094:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 328 00000100:00100000:3.0:1788330208.002106:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766108416:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330208.002277:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766108416:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 173us (7789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330208.002286:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 328 00000100:00100000:3.0:1788330208.002306:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 329 00000100:00100000:3.0:1788330208.002312:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766108928:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330208.002335:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766108928:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 24us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330208.002341:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 329 00000100:00080000:2.0:1788330208.003200:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788330208.006084:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766108672 00000100:00100000:1.0:1788330208.006107:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766108672 00000100:00100000:1.0:1788330208.006287:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 137 00000100:00100000:1.0:1788330208.006303:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2411:x1875199766108672:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330208.006430:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2411:x1875199766108672:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 131us (4919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330208.006439:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 137 00000100:00080000:2.0:1788330208.006481:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788330208.155325:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788330208.476103:0:13809:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788330208.476118:0:13809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788330208.476143:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788330208.476469:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788330208.733042:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788330209.179304:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330209.692638:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792397312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788330209.692801:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792397440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330209.692828:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330209.692856:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330209.692910:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792397440 00000100:00100000:2.0:1788330209.692922:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792397440 00000100:00100000:2.0:1788330209.692998:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788330209.693011:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792397440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788330209.693058:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788330209.693403:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792397312 00000100:00100000:3.0:1788330209.693409:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792397312 00000100:00080000:1.0:1788330209.693448:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330209.693461:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788330209.693469:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792397312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788330209.693515:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788330209.693572:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792397312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330209.693581:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000004:00080000:0.0:1788330209.693755:0:9991:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 413665602082ns, next at 414665598136ns, rc = 0 00000100:00100000:1.0:1788330209.694045:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792397312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788330209.694081:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330209.694094:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792397184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330209.694132:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330209.699782:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792397184 00000100:00100000:0.0:1788330209.699807:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792397184 00000100:00100000:0.0:1788330209.700984:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788330209.701004:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875199792397184:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330209.701013:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792397440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8003us (8153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330209.701024:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00002000:00000024:0.0:1788330209.701046:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788330209.701127:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875199792397184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (6995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330209.701134:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788330209.701219:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792397440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330209.701628:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792397184:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788330209.706311:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788330209.709681:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:2.0:1788330209.709746:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000004:00080000:2.0:1788330209.709766:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788330209.709791:0:6501:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99edc177a540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788330209.709797:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99eefe426700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99edc177a6c0 00000020:00080000:2.0:1788330209.709800:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99eefe426000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99edc7e91600 00010000:00010000:0.0:1788330209.709804:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1813 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788330209.709826:0:6501:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1788330209.709841:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1813 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.709849:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1813 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.709855:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330209.709862:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1813 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.709870:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1813 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788330209.709883:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00010000:00010000:0.0:1788330209.709892:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff99edc7580900) 00010000:00010000:0.0:1788330209.709894:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330209.709900:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1813 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.709905:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1813 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788330209.709987:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:3.0:1788330209.710339:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330209.710376:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792397568:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788330209.710477:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330209.710790:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792397568 00000100:00100000:1.0:1788330209.710801:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792397568 00000100:00100000:1.0:1788330209.710876:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788330209.710889:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1875199792397568:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788330209.711084:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788330209.711089:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788330203 -> 1788330203 00002000:00010000:1.0:1788330209.711091:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 1788330203 -> 1788330203 00002000:00010000:1.0:1788330209.711094:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788330203 -> 1788330203 00002000:00010000:1.0:1788330209.711096:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788330209.711191:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3646:x1875199792397568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 303us (712us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788330209.711210:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1788330209.711280:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99edc7f77480/2, rc 0, transno 4294967313 00000100:00100000:1.0:1788330209.711288:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792397568:0@lo:2:osp-syn-1-0.0 00000001:00080000:0.0:1788330209.715949:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1788330209.715978:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:3.0:1788330210.206448:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788330210.212146:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:3.0:1788330211.159552:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330211.165084:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766109056 00000100:00100000:1.0:1788330211.165103:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766109056 00000100:00100000:1.0:1788330211.165219:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 147 00000100:00100000:1.0:1788330211.165232:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+13:11096:x1875199766109056:12345-192.168.202.50@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788330211.165347:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+13:11096:x1875199766109056:12345-192.168.202.50@tcp:60:lhsmtool_posix.0 Request processed in 118us (5804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330211.165367:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 147 00000100:00080000:1.0:1788330211.168930:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330211.176811:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330211.176958:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766109184 00000100:00100000:3.0:1788330211.176969:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766109184 00000100:00080000:1.0:1788330211.177145:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788330211.177222:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 148 00000100:00100000:3.0:1788330211.177236:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:11096:x1875199766109184:12345-192.168.202.50@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788330211.177356:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:11096:x1875199766109184:12345-192.168.202.50@tcp:60:lhsmtool_posix.0 Request processed in 123us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330211.177365:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 148 00000100:00100000:3.0:1788330211.180961:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330211.181128:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766109440 00000100:00100000:2.0:1788330211.181140:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766109440 00000100:00100000:2.0:1788330211.181828:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 35 00000100:00100000:2.0:1788330211.181844:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+13:11096:x1875199766109440:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788330211.182141:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:11096:x1875199766109440:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 300us (1191us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788330211.182167:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 35 00010000:00010000:3.0:1788330211.227656:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330211.231568:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330211.231611:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792397696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330211.231741:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330211.232018:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792397696 00000100:00100000:0.0:1788330211.232031:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792397696 00000100:00100000:0.0:1788330211.232139:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788330211.232206:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792397696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788330211.232268:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330211.232355:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792397696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 204us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330211.232383:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:1.0:1788330211.232660:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330211.232928:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792397696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330211.232974:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792397824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330211.233020:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330211.233206:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792397824 00000100:00100000:0.0:1788330211.233281:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792397824 00000100:00080000:1.0:1788330211.233364:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330211.233419:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788330211.233429:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792397824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788330211.233448:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330211.233723:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792397824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 295us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330211.233731:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788330211.235570:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1788330211.235583:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99eec3742300, transno 4294967305 00000100:00100000:1.0:1788330211.235624:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792397824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330211.430350:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330211.430543:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766109568 00000100:00100000:0.0:1788330211.430559:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766109568 00000100:00100000:0.0:1788330211.430673:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 149 00000100:00100000:0.0:1788330211.430689:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:11894:x1875199766109568:12345-192.168.202.50@tcp:101:lsof.0 00010000:00010000:0.0:1788330211.430723:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330211.430759:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd189f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105fdf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330211.430855:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd18a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330211.430872:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd18a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330211.430887:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd18a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330211.430951:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788330211.430956:0:6522:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788330211.431034:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd18a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330211.431078:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd189f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fdf expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330211.431104:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd18a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fdf expref: 6 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330211.431115:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95b00) 00010000:00010000:0.0:1788330211.431118:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788330211.431123:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326a00, rc 0) 00000100:00080000:1.0:1788330211.432067:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330211.432246:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:11894:x1875199766109568:12345-192.168.202.50@tcp:101:lsof.0 Request processed in 1555us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330211.432257:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 149 00010000:00010000:2.0:1788330212.251706:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330212.251924:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef58c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792397952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330212.252034:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330212.252480:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792397952 00000100:00100000:3.0:1788330212.252492:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792397952 00000100:00100000:3.0:1788330212.252559:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788330212.252571:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792397952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788330212.252619:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788330212.252698:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792397952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330212.252707:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788330212.252858:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef58c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792397952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330212.763495:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792398208:0@lo:400:kworker.0 00000100:00100000:0.0:1788330212.763606:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330212.763821:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792398080:0@lo:400:kworker.0 00000100:00100000:1.0:1788330212.763867:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330212.763954:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792398208 00000100:00100000:1.0:1788330212.763964:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792398208 00000100:00100000:1.0:1788330212.764032:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788330212.764044:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792398208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330212.764223:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792398080 00000100:00100000:3.0:1788330212.764228:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792398080 00000100:00100000:3.0:1788330212.764261:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788330212.764268:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792398080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330212.764309:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792398080:12345-0@lo:400:kworker.0 Request processed in 41us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330212.764317:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788330212.764376:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792398080:0@lo:400:kworker.0 00000100:00100000:3.0:1788330212.764408:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792398336:0@lo:400:kworker.0 00000100:00100000:3.0:1788330212.764439:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330212.764622:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792398336 00000100:00100000:3.0:1788330212.764627:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792398336 00000100:00100000:3.0:1788330212.764656:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788330212.764662:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792398336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330212.764701:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792398336:12345-0@lo:400:kworker.0 Request processed in 39us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330212.764722:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788330212.764758:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792398336:0@lo:400:kworker.0 00000100:00100000:1.0:1788330212.765979:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792398208:12345-0@lo:400:kworker.0 Request processed in 1927us (2363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330212.765992:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788330212.770660:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792398208:0@lo:400:kworker.0 00000100:00100000:3.0:1788330212.772215:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792398464:0@lo:400:kworker.0 00000100:00100000:3.0:1788330212.772317:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330212.772409:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792398464 00000100:00100000:0.0:1788330212.772417:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792398464 00000100:00100000:0.0:1788330212.772500:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788330212.772513:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792398464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330212.774286:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792398592:0@lo:400:kworker.0 00000100:00100000:1.0:1788330212.774368:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330212.774449:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792398592 00000100:00100000:1.0:1788330212.774456:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792398592 00000100:00100000:1.0:1788330212.774532:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788330212.774545:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792398592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330212.774620:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792398592:12345-0@lo:400:kworker.0 Request processed in 78us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330212.774628:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00080000:1.0:1788330212.774655:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330212.774711:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792398592:0@lo:400:kworker.0 00000100:00100000:0.0:1788330212.777461:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792398464:12345-0@lo:400:kworker.0 Request processed in 4937us (5130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330212.777490:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788330212.778076:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792398848:0@lo:400:kworker.0 00000100:00100000:1.0:1788330212.778186:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330212.778223:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792399360:0@lo:400:kworker.0 00000100:00100000:1.0:1788330212.778249:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330212.778278:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788330212.778284:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792398720:0@lo:400:kworker.0 00000100:00100000:1.0:1788330212.778314:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330212.778336:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792399232:0@lo:400:kworker.0 00000100:00100000:1.0:1788330212.778361:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330212.778404:0:13829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792398848 00000100:00100000:1.0:1788330212.778414:0:13829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792398848 00000100:00100000:1.0:1788330212.778584:0:13829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792399360 00000100:00100000:1.0:1788330212.778588:0:13829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792399360 00000100:00100000:1.0:1788330212.778627:0:13829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788330212.778640:0:13829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792398848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330212.778714:0:13829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792398848:12345-0@lo:400:kworker.0 Request processed in 77us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330212.778721:0:13829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788330212.778740:0:13829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788330212.778747:0:13829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792399360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330212.778789:0:13829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792399360:12345-0@lo:400:kworker.0 Request processed in 43us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330212.778796:0:13829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788330212.778824:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792398720 00000100:00100000:1.0:1788330212.778828:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792398720 00000100:00100000:1.0:1788330212.778859:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792399232 00000100:00100000:1.0:1788330212.778862:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792399232 00000100:00100000:1.0:1788330212.778883:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788330212.778890:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792398720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330212.779074:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792398720:12345-0@lo:400:kworker.0 Request processed in 185us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330212.779082:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788330212.779094:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788330212.779100:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875199792399232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330212.779132:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875199792399232:12345-0@lo:400:kworker.0 Request processed in 32us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330212.779138:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00080000:1.0:1788330212.779196:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788330212.779202:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788330212.779236:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcfa680 x1875199792398720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330212.779253:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792398720:0@lo:400:kworker.0 00010000:00080000:1.0:1788330212.779266:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eee7640000 x1875199792399232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330212.779274:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792399232:0@lo:400:kworker.0 00000100:00100000:1.0:1788330212.779299:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792398848:0@lo:400:kworker.0 00000100:00100000:1.0:1788330212.779309:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792399360:0@lo:400:kworker.0 00000100:00100000:3.0:1788330212.781911:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792398464:0@lo:400:kworker.0 00000100:00100000:3.0:1788330212.781968:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792398976:0@lo:400:kworker.0 00000100:00100000:3.0:1788330212.782054:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330212.782109:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792399488:0@lo:400:kworker.0 00000100:00100000:3.0:1788330212.782135:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330212.782199:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792398976 00000100:00100000:3.0:1788330212.782208:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792398976 00000100:00100000:3.0:1788330212.782259:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792399488 00000100:00100000:3.0:1788330212.782263:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792399488 00000100:00100000:3.0:1788330212.782297:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788330212.782309:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792398976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330212.782368:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792398976:12345-0@lo:400:kworker.0 Request processed in 61us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330212.782376:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788330212.782394:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788330212.782401:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792399488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330212.782433:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792399488:12345-0@lo:400:kworker.0 Request processed in 32us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330212.782438:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788330212.782599:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1788330212.782621:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99edc7db1c00, transno 4294967310 00000004:00080000:3.0:1788330212.782634:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967313 00000004:00080000:3.0:1788330212.782663:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99edc7f77480, transno 4294967313 00000100:00100000:3.0:1788330212.782669:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792399488:0@lo:400:kworker.0 00000100:00100000:3.0:1788330212.782691:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792398976:0@lo:400:kworker.0 00000100:00100000:3.0:1788330212.782763:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330212.782772:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792399104:0@lo:400:kworker.0 00000100:00100000:3.0:1788330212.782805:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330212.783808:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792399104 00000100:00100000:1.0:1788330212.783822:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792399104 00000100:00100000:1.0:1788330212.783888:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788330212.783909:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef58c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792399104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330212.784000:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef58c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792399104:12345-0@lo:400:kworker.0 Request processed in 94us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330212.784009:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:1.0:1788330212.784035:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788330212.784041:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330212.784365:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792399104:0@lo:400:kworker.0 00000100:00100000:3.0:1788330213.108147:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330213.108286:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330213.108313:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330213.108338:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330213.108358:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330213.108394:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330213.108448:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330213.108578:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766109952 00000100:00100000:0.0:1788330213.108604:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766109952 00000100:00100000:0.0:1788330213.108695:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766110464 00000100:00100000:0.0:1788330213.108699:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766110464 00000100:00100000:0.0:1788330213.108716:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766109824 00000100:00100000:0.0:1788330213.108719:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766109824 00000100:00100000:0.0:1788330213.108733:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766110336 00000100:00100000:0.0:1788330213.108735:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766110336 00000100:00100000:0.0:1788330213.108754:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 336 00000100:00100000:0.0:1788330213.108766:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766109952:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330213.108870:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766109952:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 106us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330213.108879:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 336 00000100:00100000:0.0:1788330213.108903:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 337 00000100:00100000:0.0:1788330213.108910:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766110464:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330213.108936:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766110464:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 27us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330213.108943:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 337 00000100:00100000:0.0:1788330213.108956:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 338 00000100:00100000:0.0:1788330213.108962:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:2411:x1875199766109824:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330213.108991:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:2411:x1875199766109824:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 30us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330213.108998:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 338 00000100:00100000:0.0:1788330213.109010:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 339 00000100:00100000:0.0:1788330213.109016:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc76df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2411:x1875199766110336:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330213.109039:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc76df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2411:x1875199766110336:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 23us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330213.109053:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 339 00000100:00100000:1.0:1788330213.110481:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766110208 00000100:00100000:1.0:1788330213.110503:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766110208 00000100:00100000:1.0:1788330213.110598:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766110080 00000100:00100000:1.0:1788330213.110603:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766110080 00000100:00100000:1.0:1788330213.110644:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 142 00000100:00100000:1.0:1788330213.110655:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2411:x1875199766110208:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330213.110744:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2411:x1875199766110208:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 92us (2429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330213.110754:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 142 00000100:00100000:1.0:1788330213.110772:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 143 00000100:00100000:1.0:1788330213.110793:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766110080:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330213.110822:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766110080:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 43us (2428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330213.110829:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 143 00000100:00100000:2.0:1788330213.111209:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766109696 00000100:00100000:2.0:1788330213.111217:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766109696 00000100:00100000:2.0:1788330213.111272:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 391 00000100:00100000:2.0:1788330213.111283:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00be9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2411:x1875199766109696:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330213.111329:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00be9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2411:x1875199766109696:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 50us (3200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330213.111336:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 391 00000100:00080000:3.0:1788330213.111754:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330213.111761:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330213.111764:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788330213.111768:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788330213.278514:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330214.300348:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788330214.746010:0:14470:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 02:23:33 (1788330213) 00000100:00100000:0.0:1788330214.811546:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330214.811580:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792399616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330214.811692:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330214.811817:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792399616 00000100:00100000:0.0:1788330214.811828:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792399616 00000100:00100000:0.0:1788330214.811919:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788330214.811933:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792399616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788330214.811980:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788330214.812043:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792399616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330214.812051:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:0.0:1788330214.812086:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330214.812141:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792399616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330214.812775:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330214.812795:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792399744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330214.812850:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330214.812914:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792399744 00000100:00100000:1.0:1788330214.812921:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792399744 00000100:00100000:1.0:1788330214.812965:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788330214.812974:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792399744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788330214.813013:0:7831:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788330214.813057:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792399744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330214.813064:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788330214.813106:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792399744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330214.817834:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792399872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788330214.817962:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330214.819331:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792399872 00000100:00100000:0.0:1788330214.819352:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792399872 00000100:00100000:0.0:1788330214.819762:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788330214.819778:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792399872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788330214.819815:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00080000:3.0:1788330214.821185:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330214.822854:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792399872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3064us (4876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330214.822876:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788330214.826661:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792399872:0@lo:13:osp-pre-1-1.0 00000001:00080000:0.0:1788330214.827427:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1788330214.827443:0:6501:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1788330214.827781:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1788330214.827799:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788330215.323342:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330216.065050:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330216.070655:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766110720 00000100:00100000:0.0:1788330216.070674:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766110720 00000100:00100000:0.0:1788330216.070874:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 150 00000100:00100000:0.0:1788330216.070899:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+13:12161:x1875199766110720:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330216.070925:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330216.070955:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd18ad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105fe6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071059:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18b4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071074:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071088:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071108:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd18bb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071114:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd18bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071120:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd18bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071295:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd18c2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071306:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd18c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071313:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd18c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330216.071336:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788330216.071461:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071470:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18b4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071478:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18b4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071484:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330216.071489:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18b4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071497:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18b4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071510:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99edc65db300) 00010000:00010000:0.0:1788330216.071513:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330216.071535:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071543:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071558:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd18bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071564:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd18bb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071587:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd18bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071593:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330216.071596:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd18bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071603:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd18bb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071610:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99eec91de500) 00010000:00010000:0.0:1788330216.071612:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330216.071615:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd18bb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071620:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd18bb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071919:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd18ad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fe6 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071935:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd18c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fe6 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.071943:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99eec9216d00) 00010000:00010000:0.0:1788330216.071946:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330216.071949:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326800, rc 0) 00000100:00100000:0.0:1788330216.072055:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:12161:x1875199766110720:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 1170us (7015us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788330216.072073:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 150 00000100:00080000:3.0:1788330216.076769:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330216.091881:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330216.092513:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766110848 00000100:00100000:3.0:1788330216.092537:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766110848 00000100:00100000:3.0:1788330216.092619:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 151 00000100:00100000:3.0:1788330216.092654:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:12161:x1875199766110848:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788330216.092817:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:12161:x1875199766110848:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 Request processed in 167us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330216.092825:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 151 00000100:00100000:2.0:1788330216.096258:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330216.096498:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330216.096604:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766110976 00000100:00100000:0.0:1788330216.096616:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766110976 00000100:00100000:3.0:1788330216.096629:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766111104 00000100:00100000:3.0:1788330216.096633:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766111104 00000100:00100000:3.0:1788330216.096695:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 152 00000100:00100000:3.0:1788330216.096707:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:12161:x1875199766111104:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788330216.096824:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:12161:x1875199766111104:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 Request processed in 119us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330216.096832:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 152 00000100:00100000:0.0:1788330216.096890:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:0.0:1788330216.096899:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:2410:x1875199766110976:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330216.096912:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330216.096937:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd18c2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fe6 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330216.096960:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99eec9216d00) 00010000:00010000:0.0:1788330216.096966:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330216.096987:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:2410:x1875199766110976:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 90us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330216.096993:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00080000:1.0:1788330216.097572:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788330216.348312:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792400000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788330216.348416:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330216.348519:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330216.348527:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792400128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330216.348552:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330216.348597:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792400000 00000100:00100000:0.0:1788330216.348608:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792400000 00000100:00100000:0.0:1788330216.348675:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792400128 00000100:00100000:0.0:1788330216.348677:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792400128 00000100:00100000:0.0:1788330216.348697:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788330216.348708:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792400000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788330216.348753:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330216.348844:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792400000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330216.348947:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788330216.348960:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792400128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330216.348974:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330216.349009:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792400128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330216.349016:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788330216.349204:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:0.0:1788330216.349226:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330216.349276:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792400128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330216.349292:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792400000:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788330216.351834:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788330216.667437:0:13809:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788330216.667448:0:13809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788330216.667909:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788330216.667929:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788330216.929041:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788330217.371655:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330217.381925:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330217.381950:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792400256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330217.382056:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330217.382240:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792400256 00000100:00100000:3.0:1788330217.382249:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792400256 00000100:00100000:3.0:1788330217.382307:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788330217.382319:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792400256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788330217.382360:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788330217.382429:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792400256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330217.382455:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788330217.382505:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792400256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788330217.883815:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792400768:0@lo:400:kworker.0 00000100:00100000:3.0:1788330217.884272:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec9758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792400384:0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.884481:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec9758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792400512:0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.884576:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330217.884649:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec3742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792401024:0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.884675:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330217.884695:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792401536:0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.884718:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330217.884748:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788330217.884755:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792400640:0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.884780:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330217.884799:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec3742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792401152:0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.884826:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330217.884976:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330217.885020:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792400768 00000100:00100000:2.0:1788330217.885031:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792400768 00000100:00100000:2.0:1788330217.885099:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788330217.885112:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792400768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330217.885224:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792400768:12345-0@lo:400:kworker.0 Request processed in 114us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330217.885233:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788330217.885664:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330217.887676:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792400384 00000100:00100000:2.0:1788330217.887700:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792400384 00000100:00100000:2.0:1788330217.887777:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1788330217.887789:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3649:x1875199792400384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.887997:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792401664:0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.895030:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330217.895147:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792400512 00000100:00100000:2.0:1788330217.896496:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3649:x1875199792400384:12345-0@lo:400:kworker.0 Request processed in 8700us (10822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330217.896516:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1788330217.897689:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792400512 00000100:00100000:0.0:1788330217.897765:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792401024 00000100:00100000:0.0:1788330217.897767:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792401024 00000100:00100000:0.0:1788330217.897796:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792401536 00000100:00100000:0.0:1788330217.897799:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792401536 00000100:00100000:0.0:1788330217.897812:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792400640 00000100:00100000:0.0:1788330217.897827:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792400640 00000100:00100000:0.0:1788330217.899267:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788330217.899433:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792400512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.899592:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792400512:12345-0@lo:400:kworker.0 Request processed in 173us (15016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330217.899612:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788330217.899658:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788330217.899668:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792401024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.899701:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792401024:12345-0@lo:400:kworker.0 Request processed in 37us (15025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330217.899706:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788330217.899718:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788330217.899726:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792401536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.899754:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792401536:12345-0@lo:400:kworker.0 Request processed in 30us (15036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330217.899759:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788330217.899770:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788330217.899777:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792400640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.899807:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792400640:12345-0@lo:400:kworker.0 Request processed in 31us (15027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330217.899813:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788330217.903030:0:13409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792401152 00000100:00100000:0.0:1788330217.903054:0:13409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792401152 00000100:00100000:0.0:1788330217.903138:0:13409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792401664 00000100:00100000:0.0:1788330217.903142:0:13409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792401664 00000100:00100000:0.0:1788330217.904967:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788330217.904988:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792401152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.905145:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792401152:12345-0@lo:400:kworker.0 Request processed in 163us (20316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330217.905188:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788330217.905213:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788330217.905220:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792401664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.905256:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792401664:12345-0@lo:400:kworker.0 Request processed in 37us (10239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330217.905262:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:0.0:1788330217.907520:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330217.907539:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788330217.907704:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792400768:0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.907724:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec3743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792401280:0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.907807:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330217.907853:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792401792:0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.907876:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330217.907937:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792401280 00000100:00100000:0.0:1788330217.907945:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792401280 00000100:00100000:0.0:1788330217.907993:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792401792 00000100:00100000:0.0:1788330217.907996:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792401792 00000100:00100000:0.0:1788330217.908024:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788330217.908034:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792401280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.908102:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792401280:12345-0@lo:400:kworker.0 Request processed in 69us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330217.908111:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788330217.908172:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788330217.908180:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792401792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.908231:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792401792:12345-0@lo:400:kworker.0 Request processed in 52us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330217.908237:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1788330217.908261:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330217.908283:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec3743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792401280:0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.908297:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792401792:0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.908343:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec9758a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792400384:0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.908353:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792400896:0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.908385:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330217.908409:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792401408:0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.908431:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330217.908476:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792401664:0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.908492:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec9758000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792400512:0@lo:400:kworker.0 00010000:00080000:0.0:1788330217.908509:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eec3742300 x1875199792401024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330217.908522:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec3742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792401024:0@lo:400:kworker.0 00010000:00080000:0.0:1788330217.908537:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcae680 x1875199792401536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330217.908546:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792401536:0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.908575:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792400640:0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.908590:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec3742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792401152:0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.908625:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792400896 00000100:00100000:0.0:1788330217.908629:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792400896 00000100:00100000:0.0:1788330217.908671:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792401408 00000100:00100000:0.0:1788330217.908673:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792401408 00000100:00100000:0.0:1788330217.908695:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788330217.908703:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792400896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.910445:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792400896:12345-0@lo:400:kworker.0 Request processed in 1728us (2042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330217.910462:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788330217.910507:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788330217.910520:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792401408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.910566:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792401408:12345-0@lo:400:kworker.0 Request processed in 52us (2134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330217.910573:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00080000:0.0:1788330217.910624:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330217.910708:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792400896:0@lo:400:kworker.0 00000100:00100000:0.0:1788330217.910723:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792401408:0@lo:400:kworker.0 00000100:00100000:2.0:1788330218.213482:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330218.213533:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330218.213566:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330218.213598:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330218.213621:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330218.213642:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330218.213669:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330218.214209:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766111360 00000100:00100000:1.0:1788330218.214233:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766111360 00000100:00100000:1.0:1788330218.214643:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766111872 00000100:00100000:1.0:1788330218.214649:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766111872 00000100:00100000:1.0:1788330218.214671:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766111488 00000100:00100000:1.0:1788330218.214676:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766111488 00000100:00100000:1.0:1788330218.214693:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766112000 00000100:00100000:1.0:1788330218.214696:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766112000 00000100:00100000:1.0:1788330218.214721:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 346 00000100:00100000:1.0:1788330218.214735:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:2413:x1875199766111360:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330218.214862:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:2413:x1875199766111360:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 128us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330218.214871:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 346 00000100:00100000:1.0:1788330218.214892:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 347 00000100:00100000:1.0:1788330218.214899:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2413:x1875199766111872:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330218.214927:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2413:x1875199766111872:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 28us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330218.214934:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 347 00000100:00100000:1.0:1788330218.214946:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 348 00000100:00100000:1.0:1788330218.214953:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766111488:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330218.214979:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766111488:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 28us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330218.214985:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 348 00000100:00100000:1.0:1788330218.214996:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 349 00000100:00100000:1.0:1788330218.215001:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766112000:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330218.215023:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2413:x1875199766112000:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 22us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330218.215038:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 349 00000100:00080000:1.0:1788330218.215059:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788330218.215064:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330218.216306:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766111616 00000100:00100000:2.0:1788330218.216321:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766111616 00000100:00100000:2.0:1788330218.216400:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766111744 00000100:00100000:2.0:1788330218.216405:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766111744 00000100:00100000:2.0:1788330218.216439:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 148 00000100:00100000:2.0:1788330218.216452:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766111616:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330218.216527:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766111616:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 79us (2993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330218.216534:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 148 00000100:00100000:2.0:1788330218.216553:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 149 00000100:00100000:2.0:1788330218.216562:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2413:x1875199766111744:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330218.216589:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2413:x1875199766111744:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 29us (2946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330218.216595:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 149 00000100:00100000:2.0:1788330218.216622:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766111232 00000100:00100000:2.0:1788330218.216627:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766111232 00000100:00100000:2.0:1788330218.216665:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 393 00000100:00100000:2.0:1788330218.216671:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2413:x1875199766111232:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330218.216699:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2413:x1875199766111232:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 28us (3100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330218.216705:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 393 00000100:00080000:1.0:1788330218.217929:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788330218.217938:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788330218.397006:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330218.449333:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330218.449456:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766112128 00000100:00100000:1.0:1788330218.449472:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766112128 00000100:00100000:1.0:1788330218.449563:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 153 00000100:00100000:1.0:1788330218.449580:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:12203:x1875199766112128:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1788330218.449612:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330218.449643:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd18d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105fed expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.449730:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd18d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.449747:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd18d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.449761:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd18d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.449776:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd18de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.449782:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd18de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.449789:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd18de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.450025:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd18d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.450034:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd18d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.450042:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd18d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.450048:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330218.450054:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd18d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.450063:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd18d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.450078:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95b00) 00010000:00010000:1.0:1788330218.450082:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330218.450088:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd18d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.450095:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd18d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.450181:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd18de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.450189:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd18de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.450195:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd18de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.450208:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330218.450211:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd18de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.450218:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd18de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.450227:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99edc75ac000) 00010000:00010000:1.0:1788330218.450230:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330218.450232:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd18de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.450238:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd18de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.450277:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd18d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fed expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.450289:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95b00) 00010000:00010000:1.0:1788330218.450292:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330218.450296:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd18d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fed expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.450305:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79c00, rc 0) 00000100:00100000:1.0:1788330218.450433:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:12203:x1875199766112128:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 855us (1113us total) trans 0 rc 301/301 00000100:00100000:1.0:1788330218.450441:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 153 00000100:00100000:1.0:1788330218.467214:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330218.467880:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766112384 00000100:00100000:3.0:1788330218.467893:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766112384 00000100:00100000:3.0:1788330218.467965:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 154 00000100:00100000:3.0:1788330218.467977:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+14:12203:x1875199766112384:12345-192.168.202.50@tcp:36:lfs.0 00010000:00010000:3.0:1788330218.468053:0:12916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330218.468097:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765aa00/0x8475908e9fd1224 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e11 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330218.468131:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95b00) 00010000:00010000:3.0:1788330218.468138:0:12916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330218.468242:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd18e5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330218.468261:0:12916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd18a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fdf expref: 5 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330218.468281:0:12916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd18e5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330218.468328:0:12916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd18a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fdf expref: 5 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330218.468343:0:12916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd18a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fdf expref: 5 pid: 6522 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330218.468371:0:12916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792401920:192.168.202.50@tcp:104: 00000100:00100000:3.0:1788330218.468494:0:12916:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10886c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330218.471139:0:12916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792401920:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330218.471210:0:12916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd18e5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330218.472727:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330218.472958:0:13195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766112512 00000100:00100000:3.0:1788330218.472970:0:13195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766112512 00010000:00010000:3.0:1788330218.473032:0:13195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd18a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fdf expref: 6 pid: 6522 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330218.473085:0:13195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 80 00000100:00100000:3.0:1788330218.473100:0:13195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9758000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2412:x1875199766112512:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330218.473130:0:13195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330218.473140:0:13195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd18a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fdf expref: 6 pid: 6522 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330218.473192:0:13195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd18a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fdf expref: 6 pid: 6522 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330218.473225:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd18a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fdf expref: 6 pid: 6522 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330218.473248:0:13195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95b00) 00010000:00010000:3.0:1788330218.473254:0:13195:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd18e5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330218.473265:0:13195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd18e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330218.473306:0:13195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd18e5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330218.473336:0:13195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330218.473412:0:13195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9758000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2412:x1875199766112512:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 315us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330218.473419:0:13195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 80 00010000:00010000:0.0:1788330218.474138:0:12916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd18e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.474195:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd18e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.474229:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18ec lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.474241:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.474252:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.475025:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd18f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.475039:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd18f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.475048:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd18f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788330218.475066:0:12916:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000868740b7 reply state 0000000031b19851 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd18f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.475079:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd18f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.475088:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:0.0:1788330218.475091:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788330218.475095:0:12916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788330218.475103:0:12916:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788330218.475142:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd18e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.475177:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd18e5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.475186:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd18e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.475192:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330218.475197:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd18e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.475207:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd18e5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.475220:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95b00) 00010000:00010000:0.0:1788330218.475223:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330218.475228:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd18e5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.475235:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd18e5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788330218.475255:0:12916:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000868740b7 reply state 0000000031b19851 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.475265:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.475271:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99eec91def00) 00010000:00010000:0.0:1788330218.475274:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788330218.475283:0:12916:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788330218.475394:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:12203:x1875199766112384:12345-192.168.202.50@tcp:36:lfs.0 Request processed in 7416us (8193us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788330218.475405:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 154 00000100:00100000:1.0:1788330218.552287:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330218.552383:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766112640 00000100:00100000:2.0:1788330218.552396:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766112640 00000100:00100000:2.0:1788330218.552509:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 155 00000100:00100000:2.0:1788330218.552523:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:12211:x1875199766112640:12345-192.168.202.50@tcp:101:lctl.0 00010000:00010000:2.0:1788330218.552557:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330218.552591:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd18fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105ff4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.552686:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd1901 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.552704:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd1901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.552719:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd1901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330218.552786:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788330218.552791:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330218.552818:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd1901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.552868:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd18fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ff4 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.552888:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd1901 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ff4 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.552899:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95d00) 00010000:00010000:2.0:1788330218.552902:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330218.552918:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039800, rc 0) 00000100:00100000:2.0:1788330218.552998:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+16:12211:x1875199766112640:12345-192.168.202.50@tcp:101:lctl.0 Request processed in 476us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330218.553007:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 155 00000100:00100000:3.0:1788330218.589085:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330218.589191:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766112768 00000100:00100000:1.0:1788330218.589206:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766112768 00000100:00100000:1.0:1788330218.589301:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 156 00000100:00100000:1.0:1788330218.589317:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+16:12217:x1875199766112768:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:1.0:1788330218.589354:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330218.589390:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1908 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6105ffb expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589481:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd190f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589499:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd190f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589515:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd190f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589528:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1916 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589537:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1916 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589544:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1916 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589654:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd191d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589660:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd191d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589679:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd191d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330218.589717:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788330218.589721:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788330218.589745:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd191d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589758:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd190f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589763:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd190f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589768:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd190f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589773:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330218.589777:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd190f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589782:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd190f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589792:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95d00) 00010000:00010000:1.0:1788330218.589795:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330218.589799:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd190f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589803:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd190f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589820:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1916 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589824:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1916 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589828:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1916 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589830:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330218.589832:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1916 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589835:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1916 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589842:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99eec91def00) 00010000:00010000:1.0:1788330218.589844:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330218.589846:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1916 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589851:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1916 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589881:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1908 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ffb expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589896:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd191d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ffb expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.589911:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:1.0:1788330218.589913:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788330218.589915:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78000, rc 0) 00000100:00100000:1.0:1788330218.589992:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+17:12217:x1875199766112768:12345-192.168.202.50@tcp:101:bash.0 Request processed in 679us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330218.590001:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 156 00000100:00100000:2.0:1788330218.592553:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330218.592645:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766113024 00000100:00100000:0.0:1788330218.592659:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766113024 00000100:00100000:0.0:1788330218.592736:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 157 00000100:00100000:0.0:1788330218.592749:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+17:12217:x1875199766113024:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:0.0:1788330218.592777:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330218.592804:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1924 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106002 expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.593209:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd192b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.593228:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd192b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.593242:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd192b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.594263:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1932 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.594292:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1932 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.594305:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1932 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788330218.595261:0:12916:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788330218.598018:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1939 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.598040:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.598052:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.598100:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd192b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.598119:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd192b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.598127:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd192b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.598136:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330218.598141:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd192b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.598164:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd192b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.598185:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:0.0:1788330218.598189:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330218.598195:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd192b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.598202:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd192b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788330218.598245:0:12916:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000075aca490 reply state 00000000b4725343 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1932 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.598257:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1932 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.598264:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99eec91de500) 00010000:00010000:0.0:1788330218.598266:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788330218.598270:0:12916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788330218.598314:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1924 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106002 expref: 20 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.598331:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1939 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106002 expref: 19 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.598339:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99eec91de400) 00010000:00010000:0.0:1788330218.598341:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330218.598343:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327e00, rc 0) 00000100:00100000:0.0:1788330218.598873:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+20:12217:x1875199766113024:12345-192.168.202.50@tcp:101:bash.0 Request processed in 6125us (6333us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1788330218.598883:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 157 00000100:00100000:0.0:1788330218.606816:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330218.606993:0:13409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766113152 00000100:00100000:2.0:1788330218.607014:0:13409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766113152 00000100:00100000:2.0:1788330218.607239:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00100000:2.0:1788330218.607255:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2412:x1875199766113152:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1788330218.607286:0:13409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330218.607321:0:13409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1947 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106009 expref: -99 pid: 13409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788330218.607372:0:13409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788330218.607401:0:13409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1788330218.607407:0:13409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330218.607420:0:13409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1947 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106009 expref: 6 pid: 13409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.607444:0:13409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1947 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106009 expref: 6 pid: 13409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.607464:0:13409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038a00, rc 0) 00000100:00100000:2.0:1788330218.607580:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2412:x1875199766113152:12345-192.168.202.50@tcp:101:bash.0 Request processed in 329us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330218.607588:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00100000:2.0:1788330218.612433:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330218.612557:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766113280 00000100:00100000:0.0:1788330218.612570:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766113280 00000100:00100000:0.0:1788330218.612716:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 56 00000100:00100000:0.0:1788330218.612729:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:12217:x1875199766113280:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:0.0:1788330218.612758:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330218.612790:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd194e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106010 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.612834:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1947 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106009 expref: 7 pid: 13409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.612905:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330218.612911:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330218.612918:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd194e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106010 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.612964:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1947 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106009 expref: 7 pid: 13409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.612980:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1947 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106009 expref: 7 pid: 13409 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330218.612997:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec3742d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1875199792402048:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330218.613202:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788330218.618216:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330218.618647:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec3742d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1875199792402048:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330218.618675:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766113408 00000100:00100000:2.0:1788330218.618687:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766113408 00010000:00010000:2.0:1788330218.618745:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1947 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106009 expref: 8 pid: 13409 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330218.618801:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 81 00000100:00100000:2.0:1788330218.618813:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2413:x1875199766113408:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330218.618819:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd194e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106010 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.618831:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330218.618841:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327000, rc 0) 00010000:00010000:2.0:1788330218.618871:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1947 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106009 expref: 8 pid: 13409 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.618886:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1947 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106009 expref: 8 pid: 13409 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.618917:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1947 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106009 expref: 8 pid: 13409 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.618936:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330218.618941:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330218.618952:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd194e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106010 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.618965:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd194e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106010 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.619012:0:8454:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd194e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106010 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330218.619046:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc730f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8454:1875199792402176:192.168.202.50@tcp:105: 00000100:00100000:0.0:1788330218.619134:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:12217:x1875199766113280:12345-192.168.202.50@tcp:101:bash.0 Request processed in 6406us (7005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330218.619178:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 56 00000100:00100000:2.0:1788330218.624620:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef402b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330218.628045:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330218.628229:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc730f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8454:1875199792402176:192.168.202.50@tcp:105: 00010000:00010000:2.0:1788330218.628265:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330218.628359:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2413:x1875199766113408:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 9546us (10159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330218.628373:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 81 00000100:00100000:3.0:1788330218.628530:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766113664 00000100:00100000:3.0:1788330218.628539:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766113664 00000100:00100000:3.0:1788330218.628615:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00100000:3.0:1788330218.628627:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+20:12217:x1875199766113664:12345-192.168.202.50@tcp:35:bash.0 00000100:00100000:3.0:1788330218.629033:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:12217:x1875199766113664:12345-192.168.202.50@tcp:35:bash.0 Request processed in 408us (1005us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788330218.629041:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 36 00000040:00080000:1.0:1788330218.715562:0:13809:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788330218.715578:0:13809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788330218.715710:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1788330218.715721:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788330218.729332:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330218.729760:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766113920 00000100:00100000:2.0:1788330218.729775:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766113920 00000100:00100000:2.0:1788330218.729909:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 158 00000100:00100000:2.0:1788330218.729925:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:12227:x1875199766113920:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330218.729966:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330218.729993:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd1955 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106017 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330218.730139:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788330218.730558:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd1955 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106017 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.730577:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95d00) 00010000:00010000:2.0:1788330218.730579:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788330218.730585:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd1955 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106017 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.730603:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038a00, rc 0) 00000100:00100000:2.0:1788330218.731652:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:12227:x1875199766113920:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1724us (2329us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1788330218.731664:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 158 00000100:00100000:2.0:1788330218.737429:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330218.737665:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766114176 00000100:00100000:0.0:1788330218.737679:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766114176 00000100:00100000:0.0:1788330218.737790:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 37 00000100:00100000:0.0:1788330218.737805:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:12227:x1875199766114176:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:0.0:1788330218.738455:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+23:12227:x1875199766114176:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 650us (1040us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788330218.738466:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 37 00000100:00100000:0.0:1788330218.850833:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330218.851028:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766114304 00000100:00100000:1.0:1788330218.851040:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766114304 00000100:00100000:1.0:1788330218.851217:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 159 00000100:00100000:1.0:1788330218.851230:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+23:12233:x1875199766114304:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1788330218.851264:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330218.851292:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1963 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610601e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.851396:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd196a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.851415:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd196a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.851430:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd196a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330218.851513:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788330218.851518:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788330218.851546:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd196a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.851580:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1963 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610601e expref: 25 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.851602:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd196a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610601e expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.851612:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:1.0:1788330218.851616:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788330218.851621:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79600, rc 0) 00000100:00100000:1.0:1788330218.851717:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+24:12233:x1875199766114304:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 489us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330218.851725:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 159 00000100:00100000:1.0:1788330218.858796:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330218.858921:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766114560 00000100:00100000:0.0:1788330218.858935:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766114560 00000100:00100000:0.0:1788330218.859025:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 160 00000100:00100000:0.0:1788330218.859038:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+24:12233:x1875199766114560:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330218.859070:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330218.859099:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1971 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106025 expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.859521:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1978 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.859539:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.859554:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330218.859568:0:12916:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788330218.859734:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1971 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106025 expref: 27 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.859756:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1978 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106025 expref: 26 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.859766:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99eec91de400) 00010000:00010000:0.0:1788330218.859769:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330218.859774:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326e00, rc 0) 00000100:00100000:0.0:1788330218.860051:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+26:12233:x1875199766114560:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1013us (1270us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1788330218.860061:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 160 00000100:00100000:2.0:1788330218.885696:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330218.885811:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330218.886753:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766114944 00000100:00100000:1.0:1788330218.886770:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766114944 00000100:00100000:1.0:1788330218.886859:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:1.0:1788330218.886871:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+26:2411:x1875199766114944:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330218.886891:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330218.886924:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1978 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106025 expref: 26 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.886949:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99eec91de400) 00010000:00010000:1.0:1788330218.886970:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330218.887058:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+25:2411:x1875199766114944:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 188us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330218.887066:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:0.0:1788330218.887754:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766114816 00000100:00100000:0.0:1788330218.887762:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766114816 00000100:00100000:0.0:1788330218.887808:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 161 00000100:00100000:0.0:1788330218.887818:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+25:12233:x1875199766114816:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330218.887845:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330218.887866:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1986 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610602c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.888002:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd198d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.888020:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd198d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.888034:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd198d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330218.888063:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788330218.888690:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1986 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610602c expref: 28 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.888897:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd198d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610602c expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.888907:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99eec91de400) 00010000:00010000:0.0:1788330218.888910:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788330218.888914:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327200, rc 0) 00000100:00100000:0.0:1788330218.889038:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+27:12233:x1875199766114816:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1220us (3356us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1788330218.889047:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 161 00000100:00100000:2.0:1788330218.911830:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330218.911926:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766115072 00000100:00100000:1.0:1788330218.911941:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766115072 00000100:00100000:1.0:1788330218.912021:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00100000:1.0:1788330218.912035:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2413:x1875199766115072:12345-192.168.202.50@tcp:1:lfs.0 00010000:00010000:1.0:1788330218.912121:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000960db1ea/0x8475908e9fd199b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.912197:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd194e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106010 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.912208:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330218.912214:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330218.912220:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000960db1ea/0x8475908e9fd199b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.912272:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd194e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106010 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.912290:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd194e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106010 expref: 6 pid: 8439 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330218.912307:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7f22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1875199792402304:192.168.202.50@tcp:104: 00000100:00100000:1.0:1788330218.912427:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eed0837900 going to sleep for 11 seconds 00000100:00100000:0.0:1788330218.915078:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7f22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1875199792402304:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330218.915139:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000960db1ea/0x8475908e9fd199b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330218.916660:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330218.916748:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766115200 00000100:00100000:3.0:1788330218.916762:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766115200 00002000:00100000:3.0:1788330218.916832:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff99edc5ee9500 x1875199766115200/t0(0) o4->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:234/0 lens 504/0 e 0 to 0 dl 1788330229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788330218.916845:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99edc5ee9500 with x1875199766115200 ext(0->12) 00010000:00010000:3.0:1788330218.916855:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd194e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106010 expref: 7 pid: 8439 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330218.916872:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd194e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106010 expref: 7 pid: 8439 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788330218.916901:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99edc5ee9500 00000100:00100000:3.0:1788330218.916938:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:3.0:1788330218.916951:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2412:x1875199766115200:12345-192.168.202.50@tcp:4:lfs.0 00000100:00100000:3.0:1788330218.918684:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:2412:x1875199766115200:12345-192.168.202.50@tcp:4:lfs.0 Request processed in 1719us (2022us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788330218.918701:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 2 00002000:00100000:3.0:1788330218.918715:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff99edc5ee9500 x1875199766115200/t4294967306(0) o4->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:234/0 lens 504/448 e 0 to 0 dl 1788330229 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788330218.918727:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99edc5ee9500 with x1875199766115200 ext(0->12) 00010000:00010000:3.0:1788330218.918738:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd194e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106010 expref: 9 pid: 8439 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330218.918758:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd194e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106010 expref: 9 pid: 8439 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788330218.918767:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99edc5ee9500 00000100:00100000:1.0:1788330218.929042:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330218.929505:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766115328 00000100:00100000:2.0:1788330218.929520:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766115328 00010000:00010000:2.0:1788330218.929581:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd194e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106010 expref: 9 pid: 8439 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330218.930606:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 82 00000100:00100000:2.0:1788330218.930627:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:2413:x1875199766115328:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330218.930652:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788330218.930679:0:6508:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788330218.930683:0:6508:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788330218 00002000:00010000:2.0:1788330218.930685:0:6508:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788330218 00002000:00010000:2.0:1788330218.930687:0:6508:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788330218 00002000:00010000:2.0:1788330218.930690:0:6508:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788330218.930699:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd194e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106010 expref: 9 pid: 8439 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.930718:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd194e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106010 expref: 9 pid: 8439 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.930774:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd194e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106010 expref: 9 pid: 8439 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.930793:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788330218.930798:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788330218.930805:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000960db1ea/0x8475908e9fd199b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.930817:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000960db1ea/0x8475908e9fd199b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.930957:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330218.931058:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2413:x1875199766115328:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 439us (2034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330218.931067:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 82 00010000:00010000:0.0:1788330218.932003:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000960db1ea/0x8475908e9fd199b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.932026:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000960db1ea/0x8475908e9fd199b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.932057:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000960db1ea/0x8475908e9fd199b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.932084:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000960db1ea/0x8475908e9fd199b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.932344:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000960db1ea/0x8475908e9fd199b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.932351:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79e00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330218.932356:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000960db1ea/0x8475908e9fd199b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.932365:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000960db1ea/0x8475908e9fd199b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.932383:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000960db1ea/0x8475908e9fd199b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330218.932391:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000960db1ea/0x8475908e9fd199b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330218.932770:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2413:x1875199766115072:12345-192.168.202.50@tcp:1:lfs.0 Request processed in 20730us (20949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330218.932782:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00100000:1.0:1788330218.946328:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330218.946674:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766115584 00000100:00100000:3.0:1788330218.946690:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766115584 00000100:00100000:3.0:1788330218.946776:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 38 00000100:00100000:3.0:1788330218.946789:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9240050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+27:12233:x1875199766115584:12345-192.168.202.50@tcp:35:lfs.0 00000004:00010000:3.0:1788330218.946882:0:6525:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd198d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610602c expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788330218.947480:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1788330218.947521:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788330218.947920:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:3.0:1788330218.947969:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd19a2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330218.947990:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1939 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106002 expref: 31 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330218.948000:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd19a2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330218.948047:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1939 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106002 expref: 31 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330218.948064:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1939 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106002 expref: 31 pid: 12916 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330218.948081:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6525:1875199792402432:192.168.202.50@tcp:104: 00000100:00100000:3.0:1788330218.950734:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc1088a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788330218.963880:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330218.963982:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766115712 00000100:00100000:2.0:1788330218.963996:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766115712 00010000:00010000:2.0:1788330218.964054:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1939 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106002 expref: 32 pid: 12916 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330218.964121:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 83 00000100:00100000:2.0:1788330218.964134:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+32:2412:x1875199766115712:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330218.964204:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330218.964213:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1939 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106002 expref: 32 pid: 12916 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.964249:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1939 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106002 expref: 32 pid: 12916 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.964277:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99eec91de400) 00010000:00010000:2.0:1788330218.964283:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd19a2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.964293:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd19a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.964300:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd19a2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.964325:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330218.964397:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3742300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+32:2412:x1875199766115712:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 264us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330218.964405:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 83 00010000:00010000:3.0:1788330218.965330:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1939 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106002 expref: 31 pid: 12916 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330218.965354:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6525:1875199792402432:192.168.202.50@tcp:104: 00010000:00010000:3.0:1788330218.965384:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd19a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330218.965395:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd19a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330218.965401:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd19a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788330218.965553:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1788330218.965705:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1788330218.965819:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6525:1875199792402560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788330218.965907:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330218.966015:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc1088540 going to sleep for 11 seconds 00000100:00100000:1.0:1788330218.967773:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792402560 00000100:00100000:1.0:1788330218.967792:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792402560 00000100:00080000:2.0:1788330218.967987:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330218.968102:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788330218.968128:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6525:x1875199792402560:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788330218.968354:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6525:x1875199792402560:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 231us (2446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330218.968362:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788330218.968465:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6525:1875199792402560:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788330218.968663:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1788330218.968761:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eebb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6525:1875199792402688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788330218.968813:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788330218.974679:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788330218.976622:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792402688 00000100:00100000:2.0:1788330218.976638:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec532e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330218.976642:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792402688 00000100:00100000:3.0:1788330218.976749:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788330218.976762:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6525:x1875199792402688:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788330218.977064:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6525:x1875199792402688:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 305us (8250us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788330218.977073:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788330218.983611:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eebb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6525:1875199792402688:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788330218.983754:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1788330218.983839:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd19a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.983871:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd19a2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.983879:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd19a2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.983885:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59ca000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330218.983891:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd19a2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.983899:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd19a2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.983922:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99eec91de400) 00010000:00010000:2.0:1788330218.983926:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788330218.983932:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd19a2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330218.983938:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd19a2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788330218.984116:0:6525:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788330218.988628:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1788330218.988660:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 422960508359ns, next at 423960500898ns, rc = 0 00000001:00080000:2.0:1788330218.988681:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1788330218.988758:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99eec91de400) 00010000:00010000:2.0:1788330218.988763:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788330218.988777:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327200/0x8475908e9fd198d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610602c expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330218.988962:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9240050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+34:12233:x1875199766115584:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 42173us (42651us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1788330218.988974:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 38 00000020:00080000:2.0:1788330218.988982:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788330218.994039:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330218.994448:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766115840 00000100:00100000:1.0:1788330218.994464:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766115840 00000100:00100000:1.0:1788330218.994548:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 162 00000100:00100000:1.0:1788330218.994562:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+34:12233:x1875199766115840:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1788330218.994603:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330218.994639:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd19a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106033 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.994734:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd19a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106033 expref: 35 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.994753:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd19a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106033 expref: 35 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330218.994779:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:1.0:1788330218.994782:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330218.994787:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79c00, rc 0) 00000100:00100000:1.0:1788330218.994867:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+35:12233:x1875199766115840:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 309us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330218.994874:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 162 00000100:00100000:0.0:1788330218.998657:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330218.998759:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766116096 00000100:00100000:3.0:1788330218.998773:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766116096 00000100:00100000:3.0:1788330218.998847:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00100000:3.0:1788330218.998859:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+35:12233:x1875199766116096:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:3.0:1788330218.999240:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+36:12233:x1875199766116096:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 382us (598us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788330218.999249:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00100000:2.0:1788330219.084574:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330219.085138:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766116352 00000100:00100000:0.0:1788330219.085236:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766116352 00000100:00100000:0.0:1788330219.085393:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 163 00000100:00100000:0.0:1788330219.085410:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+36:12243:x1875199766116352:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330219.085453:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330219.085481:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd19b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610603a expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330219.085634:0:12916:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788330219.085797:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd19b0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610603a expref: 38 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.085813:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95d00) 00010000:00010000:0.0:1788330219.085816:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330219.085820:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd19b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610603a expref: 38 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.085834:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326800, rc 0) 00000100:00100000:0.0:1788330219.085920:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+37:12243:x1875199766116352:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 515us (1366us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1788330219.085926:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 163 00000100:00100000:0.0:1788330219.089454:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330219.089553:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766116480 00000100:00100000:2.0:1788330219.089569:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766116480 00000100:00100000:2.0:1788330219.089649:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 164 00000100:00100000:2.0:1788330219.089664:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+37:12243:x1875199766116480:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:2.0:1788330219.089774:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd19be lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.089798:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd19be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.089815:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd19be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.089827:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd19c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.089834:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd19c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.089840:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd19c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.089938:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd19cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.089952:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd19cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.089957:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd19cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330219.090008:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd19cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090021:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd19be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090027:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd19be lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090034:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd19be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090040:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330219.090046:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd19be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090054:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd19be lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090069:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:2.0:1788330219.090072:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330219.090078:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd19be lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090085:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd19be lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090121:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd19c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090131:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd19c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090137:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd19c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090183:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330219.090187:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd19c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090193:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd19c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090202:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99eec91de500) 00010000:00010000:2.0:1788330219.090204:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330219.090207:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd19c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090211:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd19c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090224:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd19cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090229:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd19cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090234:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd19cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090246:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330219.090249:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd19cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090255:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd19cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090263:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:2.0:1788330219.090275:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330219.090279:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd19cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.090285:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd19cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330219.090390:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+37:12243:x1875199766116480:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 727us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330219.090399:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 164 00000100:00100000:2.0:1788330219.092953:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330219.093040:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766116736 00000100:00100000:3.0:1788330219.093053:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766116736 00000100:00100000:3.0:1788330219.093922:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 40 00000100:00100000:3.0:1788330219.093938:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+37:12243:x1875199766116736:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:3.0:1788330219.094286:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+38:12243:x1875199766116736:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 352us (1347us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788330219.094313:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 40 00000100:00100000:1.0:1788330219.137878:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330219.137991:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766116992 00000100:00100000:3.0:1788330219.138006:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766116992 00000100:00100000:3.0:1788330219.138090:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 165 00000100:00100000:3.0:1788330219.138114:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+38:12246:x1875199766116992:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:3.0:1788330219.138195:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330219.138448:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd19d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106041 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.138569:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd19da lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.138590:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd19da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.138605:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd19da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.138617:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd19e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.138623:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd19e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.138629:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd19e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.138795:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd19e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.138822:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd19e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.138828:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd19e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330219.138840:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788330219.138944:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd19da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.138952:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd19da lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.138960:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd19da lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.138966:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59caa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330219.138971:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd19da lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.138979:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd19da lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.138993:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:3.0:1788330219.138996:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330219.139003:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd19da lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.139009:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd19da lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.139024:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd19e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.139035:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd19e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.139040:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd19e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.139044:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59ca600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330219.139047:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd19e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.139052:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd19e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.139058:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99eec91de500) 00010000:00010000:3.0:1788330219.139061:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330219.139064:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd19e1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.139069:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd19e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.139128:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd19d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106041 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.139226:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd19e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106041 expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.139234:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:3.0:1788330219.139237:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788330219.139246:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cb400, rc 0) 00000100:00100000:3.0:1788330219.139924:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+40:12246:x1875199766116992:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1817us (2057us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788330219.139936:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 165 00000100:00100000:0.0:1788330219.144574:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330219.144722:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766117120 00000100:00100000:3.0:1788330219.144737:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766117120 00000100:00100000:3.0:1788330219.144815:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 166 00000100:00100000:3.0:1788330219.144828:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+40:12246:x1875199766117120:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:3.0:1788330219.144924:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd19f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.144945:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd19f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.144959:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd19f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.145005:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd19f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.145013:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd19f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.145021:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd19f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.145027:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330219.145033:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd19f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.145042:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd19f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.145073:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:3.0:1788330219.145076:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788330219.145082:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd19f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.145088:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd19f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330219.145684:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+40:12246:x1875199766117120:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 854us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330219.145694:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 166 00000100:00100000:2.0:1788330219.148476:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330219.148561:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766117376 00000100:00100000:3.0:1788330219.148573:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766117376 00000100:00100000:3.0:1788330219.148650:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 41 00000100:00100000:3.0:1788330219.148665:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+40:12246:x1875199766117376:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:3.0:1788330219.149068:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+41:12246:x1875199766117376:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 406us (603us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788330219.149076:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 41 00000100:00100000:1.0:1788330219.360848:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330219.360944:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766117632 00000100:00100000:2.0:1788330219.360957:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766117632 00000100:00100000:2.0:1788330219.361042:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 167 00000100:00100000:2.0:1788330219.361058:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+41:12277:x1875199766117632:12345-192.168.202.50@tcp:101:cat.0 00010000:00010000:2.0:1788330219.361097:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330219.361219:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd19fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106048 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.361409:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1a04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.361429:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1a04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.361445:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1a04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330219.361459:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788330219.361635:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd19fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106048 expref: 44 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.361661:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1a04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106048 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.361672:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:2.0:1788330219.361676:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330219.361681:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039000, rc 0) 00000100:00100000:2.0:1788330219.361783:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+43:12277:x1875199766117632:12345-192.168.202.50@tcp:101:cat.0 Request processed in 727us (950us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788330219.361791:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 167 00000100:00100000:0.0:1788330219.367261:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330219.367927:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766117888 00000100:00100000:2.0:1788330219.367944:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766117888 00000100:00100000:2.0:1788330219.368028:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:2.0:1788330219.368043:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+43:12277:x1875199766117888:12345-192.168.202.50@tcp:35:cat.0 00000100:00100000:2.0:1788330219.368555:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+44:12277:x1875199766117888:12345-192.168.202.50@tcp:35:cat.0 Request processed in 514us (1312us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1788330219.368580:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:0.0:1788330219.372571:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330219.373534:0:13195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766118016 00000100:00100000:3.0:1788330219.373552:0:13195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766118016 00000100:00100000:3.0:1788330219.373653:0:13195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:3.0:1788330219.373669:0:13195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec986fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+44:2413:x1875199766118016:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330219.373691:0:13195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330219.373735:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1a04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106048 expref: 44 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.373785:0:13195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:3.0:1788330219.373792:0:13195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330219.373877:0:13195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec986fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+43:2413:x1875199766118016:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 211us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330219.373886:0:13195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 13 00010000:00010000:0.0:1788330219.419739:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330219.438020:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330219.438146:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766118272 00000100:00100000:3.0:1788330219.438180:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766118272 00000100:00100000:3.0:1788330219.438376:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 168 00000100:00100000:3.0:1788330219.438390:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+43:12283:x1875199766118272:12345-192.168.202.50@tcp:101:dd.0 00010000:00010000:3.0:1788330219.438430:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330219.438435:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788330219.438472:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd196a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610601e expref: 43 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.438511:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:3.0:1788330219.438519:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330219.438537:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1a12 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610604f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.438689:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a19 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.438708:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd19e8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106041 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.438718:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a19 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.438780:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd19e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106041 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.438796:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd19e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106041 expref: 43 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330219.438812:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792402816:192.168.202.50@tcp:104: 00000100:00100000:3.0:1788330219.438951:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc1088900 going to sleep for 11 seconds 00000100:00100000:1.0:1788330219.442913:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330219.443058:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792402816:192.168.202.50@tcp:104: 00010000:00010000:3.0:1788330219.443111:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a19 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330219.443660:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766118400 00000100:00100000:2.0:1788330219.443674:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766118400 00010000:00010000:2.0:1788330219.443736:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd19e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106041 expref: 44 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330219.443790:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 84 00000100:00100000:2.0:1788330219.443803:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+44:2412:x1875199766118400:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330219.443824:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330219.443834:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd19e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106041 expref: 44 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.443849:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd19e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106041 expref: 44 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.443884:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd19e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106041 expref: 44 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.443905:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:2.0:1788330219.443910:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a19 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.443921:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.443931:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a19 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.443982:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330219.444079:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+43:2412:x1875199766118400:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 278us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330219.444088:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 84 00010000:00010000:3.0:1788330219.444279:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.444288:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a19 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330219.444315:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788330219.444708:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1a12 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610604f expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.444728:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a19 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610604f expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.444737:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:3.0:1788330219.444740:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788330219.444752:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59ca600, rc 0) 00000100:00100000:3.0:1788330219.444791:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+43:12283:x1875199766118272:12345-192.168.202.50@tcp:101:dd.0 Request processed in 6405us (6788us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788330219.444799:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 168 00000100:00100000:2.0:1788330219.452615:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330219.452849:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766118528 00000100:00100000:3.0:1788330219.452864:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766118528 00000100:00100000:3.0:1788330219.452949:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 169 00000100:00100000:3.0:1788330219.452962:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+43:12283:x1875199766118528:12345-192.168.202.50@tcp:101:dd.0 00010000:00010000:3.0:1788330219.452999:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330219.453029:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1a27 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106056 expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.453077:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1a2e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.453096:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1a2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.453123:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1a2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.453626:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1a27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106056 expref: 45 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.453649:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1a2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106056 expref: 44 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.453661:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:3.0:1788330219.453664:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788330219.453678:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cb400, rc 0) 00000100:00100000:3.0:1788330219.453771:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+44:12283:x1875199766118528:12345-192.168.202.50@tcp:101:dd.0 Request processed in 811us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330219.453779:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 169 00000100:00100000:1.0:1788330219.457984:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330219.458128:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766118784 00000100:00100000:0.0:1788330219.458190:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766118784 00000100:00100000:0.0:1788330219.458261:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 170 00000100:00100000:0.0:1788330219.458283:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99ef00b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+44:12283:x1875199766118784:12345-192.168.202.50@tcp:36:dd.0 00010000:00010000:0.0:1788330219.458949:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1a35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.458975:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1a35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.458990:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1a35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788330219.459042:0:7832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1788330219.459065:0:7832:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b26a1867 reply state 00000000489c8889 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1a35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.459077:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1a35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.459084:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:0.0:1788330219.459087:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788330219.459093:0:7832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788330219.459517:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99ef00b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+47:12283:x1875199766118784:12345-192.168.202.50@tcp:36:dd.0 Request processed in 1233us (1548us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1788330219.459527:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 170 00000020:00080000:0.0:1788330219.459545:0:7832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788330219.778132:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330219.779957:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766118912 00000100:00100000:3.0:1788330219.779974:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766118912 00000100:00100000:3.0:1788330219.780538:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 171 00000100:00100000:3.0:1788330219.780553:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+47:12297:x1875199766118912:12345-192.168.202.50@tcp:101:stat.0 00010000:00010000:3.0:1788330219.780589:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330219.780620:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1a3c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610605d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.780726:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1a43 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.780744:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1a43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.780759:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1a43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.780770:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1a4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.780778:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.780785:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.780888:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1a51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.780916:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a19 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610604f expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.780925:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1a51 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.780969:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a19 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610604f expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.780986:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a19 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610604f expref: 48 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330219.781011:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792402944:192.168.202.50@tcp:104: 00000100:00100000:3.0:1788330219.784822:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc1088900 going to sleep for 11 seconds 00000100:00100000:2.0:1788330219.794327:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330219.796388:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766119168 00000100:00100000:0.0:1788330219.796414:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766119168 00000100:00100000:0.0:1788330219.796523:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:0.0:1788330219.796537:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+49:6184:x1875199766119168:12345-192.168.202.50@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788330219.796979:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+50:6184:x1875199766119168:12345-192.168.202.50@tcp:35:ldlm_bl.0 Request processed in 443us (2666us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788330219.796989:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:3.0:1788330219.811328:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792402944:192.168.202.50@tcp:104: 00010000:00010000:3.0:1788330219.811375:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1a51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330219.811693:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330219.812477:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766119296 00000100:00100000:2.0:1788330219.812490:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766119296 00010000:00010000:2.0:1788330219.812549:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a19 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610604f expref: 50 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330219.812602:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 85 00000100:00100000:2.0:1788330219.812617:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+50:2413:x1875199766119296:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330219.812638:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330219.812646:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a19 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610604f expref: 50 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.812660:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a19 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610604f expref: 50 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.812694:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a19 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610604f expref: 50 pid: 6522 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.812715:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:2.0:1788330219.812720:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1a51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.812752:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1a51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.812761:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1a51 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.812802:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330219.812901:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+49:2413:x1875199766119296:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 286us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330219.812910:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 85 00010000:00010000:0.0:1788330219.813272:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1a51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.813298:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1a51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330219.813376:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788330219.813382:0:6522:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788330219.813411:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1a51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.813429:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1a51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.813440:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1a43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.813447:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1a43 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.813454:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1a43 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.813461:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330219.813476:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1a43 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.813485:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1a43 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.813498:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:0.0:1788330219.813502:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330219.813506:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1a43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.813518:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1a43 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.813532:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.813539:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1a4a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.813544:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1a4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.813549:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59ca000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330219.813551:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1a4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.813557:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1a4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.813565:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99eec91de500) 00010000:00010000:0.0:1788330219.813567:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330219.813577:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1a4a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.813583:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1a4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.813625:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1a3c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610605d expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.813640:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1a51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610605d expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.813647:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:0.0:1788330219.813650:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330219.813652:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cb200, rc 0) 00000100:00100000:0.0:1788330219.813705:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+48:12297:x1875199766118912:12345-192.168.202.50@tcp:101:stat.0 Request processed in 33157us (35624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330219.813714:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 171 00000100:00100000:1.0:1788330219.923865:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330219.926171:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766119552 00000100:00100000:3.0:1788330219.926194:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766119552 00000100:00100000:3.0:1788330219.926535:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 172 00000100:00100000:3.0:1788330219.926550:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+48:12304:x1875199766119552:12345-192.168.202.50@tcp:36:truncate.0 00010000:00010000:3.0:1788330219.926638:0:12916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330219.926680:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1a51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610605d expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.926728:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:3.0:1788330219.926734:0:12916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330219.926980:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1a58 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.927016:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1a58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.927028:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1a58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788330219.927080:0:12916:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1788330219.927114:0:12916:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000888533a5 reply state 000000009776ad4f transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1a58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.927129:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1a58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.927136:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:3.0:1788330219.927139:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788330219.927143:0:12916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788330219.927349:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+50:12304:x1875199766119552:12345-192.168.202.50@tcp:36:truncate.0 Request processed in 802us (3501us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788330219.927358:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 172 00000020:00080000:3.0:1788330219.927364:0:12916:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788330219.931603:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330219.931756:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec9779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792403200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330219.931869:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330219.932007:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792403200 00000100:00100000:0.0:1788330219.932018:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792403200 00000100:00100000:0.0:1788330219.932105:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788330219.932119:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792403200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788330219.932180:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788330219.932233:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792403200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330219.932242:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788330219.934109:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792403328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330219.934217:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330219.934308:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792403328 00000100:00100000:1.0:1788330219.934316:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792403328 00000100:00100000:1.0:1788330219.934368:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788330219.934378:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792403328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788330219.934421:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788330219.934468:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792403328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330219.934475:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788330219.934522:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792403328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330219.934711:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec9779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792403200:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788330219.934927:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788330219.940263:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792403072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330219.940543:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330219.941054:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792403072 00000100:00100000:1.0:1788330219.941067:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792403072 00000100:00080000:3.0:1788330219.941305:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330219.941567:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788330219.941583:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792403072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788330219.941628:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788330219.941723:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792403072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 145us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330219.941732:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788330219.944071:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792403072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330220.141084:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330220.141191:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766119680 00000100:00100000:1.0:1788330220.141207:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766119680 00000100:00100000:1.0:1788330220.141339:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 173 00000100:00100000:1.0:1788330220.141355:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+50:12318:x1875199766119680:12345-192.168.202.50@tcp:101:stat.0 00010000:00010000:1.0:1788330220.141393:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330220.141426:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1a5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106064 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.141528:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1a66 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.141549:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1a66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.141566:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1a66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.141590:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1a6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.141597:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1a6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.141604:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1a6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.141708:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1a74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.141862:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1a74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.141873:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1a74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330220.141956:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788330220.141961:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788330220.141991:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1a74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.142007:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1a74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.142016:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1a66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.142023:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1a66 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.142031:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1a66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.142038:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330220.142043:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1a66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.142136:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1a66 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.142200:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:1.0:1788330220.142204:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330220.142209:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1a66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.142215:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1a66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.142242:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1a6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.142248:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1a6d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.142253:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1a6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.142257:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330220.142260:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1a6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.142266:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1a6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.142274:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99eec91de500) 00010000:00010000:1.0:1788330220.142276:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330220.142280:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1a6d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.142286:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1a6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.142324:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1a5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106064 expref: 52 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.142339:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1a74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106064 expref: 51 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.142360:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:1.0:1788330220.142362:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788330220.142365:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79400, rc 0) 00000100:00100000:1.0:1788330220.142476:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+51:12318:x1875199766119680:12345-192.168.202.50@tcp:101:stat.0 Request processed in 1124us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330220.142486:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 173 00000100:00080000:3.0:1788330220.143336:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330220.302984:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330220.303056:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766119936 00000100:00100000:0.0:1788330220.303071:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766119936 00000100:00100000:0.0:1788330220.303269:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 174 00000100:00100000:0.0:1788330220.303294:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+51:12328:x1875199766119936:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330220.303325:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330220.303355:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1a7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610606b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330220.303513:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788330220.303659:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1a7b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610606b expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330220.303678:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95d00) 00010000:00010000:0.0:1788330220.303681:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330220.303687:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1a7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610606b expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330220.303703:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327800, rc 0) 00000100:00100000:0.0:1788330220.303792:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+52:12328:x1875199766119936:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 502us (821us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1788330220.303801:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 174 00000100:00100000:0.0:1788330220.313607:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330220.313799:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766120192 00000100:00100000:2.0:1788330220.313815:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766120192 00000100:00100000:2.0:1788330220.314006:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:2.0:1788330220.314021:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9241c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+52:12328:x1875199766120192:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:2.0:1788330220.314405:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9241c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+53:12328:x1875199766120192:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 386us (813us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1788330220.314415:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:2.0:1788330220.405418:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330220.405761:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766120448 00000100:00100000:3.0:1788330220.405776:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766120448 00000100:00100000:3.0:1788330220.405867:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 175 00000100:00100000:3.0:1788330220.405880:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+53:12334:x1875199766120448:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:3.0:1788330220.405918:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330220.405949:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1a89 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106072 expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.406112:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a90 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.406132:0:12916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1a74 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106064 expref: 54 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.406142:0:12916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a90 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.406226:0:12916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1a74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106064 expref: 54 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.406242:0:12916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1a74 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106064 expref: 54 pid: 6524 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330220.406323:0:12916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792403456:192.168.202.50@tcp:104: 00000100:00100000:3.0:1788330220.406715:0:12916:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc1088900 going to sleep for 11 seconds 00000100:00100000:3.0:1788330220.410915:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330220.410977:0:12916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792403456:192.168.202.50@tcp:104: 00000100:00100000:1.0:1788330220.411005:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766120576 00010000:00010000:0.0:1788330220.411014:0:12916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a90 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330220.411016:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766120576 00010000:00010000:1.0:1788330220.411068:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1a74 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106064 expref: 55 pid: 6524 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330220.411139:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 86 00000100:00100000:1.0:1788330220.411180:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+55:2411:x1875199766120576:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330220.411202:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330220.411217:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1a74 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106064 expref: 55 pid: 6524 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.411231:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1a74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106064 expref: 55 pid: 6524 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.411266:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1a74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106064 expref: 55 pid: 6524 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.411286:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:1.0:1788330220.411306:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a90 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.411319:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.411327:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a90 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.411363:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330220.411489:0:12916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330220.411508:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330220.411532:0:12916:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788330220.411729:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1a89 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106072 expref: 56 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330220.411748:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a90 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106072 expref: 55 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330220.411758:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:0.0:1788330220.411760:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788330220.411763:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59ca600, rc 0) 00000100:00100000:1.0:1788330220.415302:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+55:2411:x1875199766120576:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 4133us (4380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330220.415322:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 86 00000100:00100000:0.0:1788330220.415417:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+54:12334:x1875199766120448:12345-192.168.202.50@tcp:101:bash.0 Request processed in 9537us (10012us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788330220.415427:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 175 00000100:00100000:0.0:1788330220.420694:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330220.420760:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766120832 00000100:00100000:2.0:1788330220.420775:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766120832 00000100:00100000:2.0:1788330220.420861:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 176 00000100:00100000:2.0:1788330220.420874:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+54:12334:x1875199766120832:12345-192.168.202.50@tcp:36:bash.0 00010000:00010000:2.0:1788330220.421254:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1a9e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.421531:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1a9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.421549:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1a9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788330220.421773:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1788330220.421803:0:6523:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000270ee641 reply state 00000000774b4d4e transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1a9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.421819:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1a9e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.421829:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:2.0:1788330220.421832:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788330220.421837:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330220.421970:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+57:12334:x1875199766120832:12345-192.168.202.50@tcp:36:bash.0 Request processed in 1096us (1291us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1788330220.421980:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 176 00000020:00080000:2.0:1788330220.421987:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788330220.433028:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330220.433555:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766120960 00000100:00100000:0.0:1788330220.433569:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766120960 00000100:00100000:0.0:1788330220.433725:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 177 00000100:00100000:0.0:1788330220.433738:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+57:12334:x1875199766120960:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:0.0:1788330220.433774:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330220.433806:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1aa5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106079 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330220.433945:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1aac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330220.433980:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a90 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106072 expref: 58 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330220.433991:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1aac lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330220.434037:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a90 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106072 expref: 58 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330220.434052:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a90 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106072 expref: 58 pid: 12916 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330220.434070:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec977a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792403584:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330220.434526:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788330220.436652:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec977a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792403584:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330220.436689:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1aac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330220.438213:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330220.439516:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766121088 00000100:00100000:0.0:1788330220.439535:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766121088 00010000:00010000:0.0:1788330220.439615:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a90 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106072 expref: 59 pid: 12916 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330220.439679:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 87 00000100:00100000:0.0:1788330220.439692:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+59:2413:x1875199766121088:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330220.439712:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330220.439736:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a90 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106072 expref: 59 pid: 12916 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330220.439754:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a90 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106072 expref: 59 pid: 12916 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330220.439786:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1a90 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106072 expref: 59 pid: 12916 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330220.440642:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:0.0:1788330220.440652:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1aac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330220.440667:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1aac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330220.440676:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1aac lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330220.440727:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330220.440831:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+58:2413:x1875199766121088:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 1137us (2628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330220.440841:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 87 00010000:00010000:3.0:1788330220.440952:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1aac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.440964:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1aac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330220.441063:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788330220.441068:0:6522:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788330220.441110:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1aac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.441181:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1aa5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106079 expref: 58 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.441205:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1aac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106079 expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.441214:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:3.0:1788330220.441217:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788330220.441220:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326c00, rc 0) 00000100:00100000:3.0:1788330220.441274:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+57:12334:x1875199766120960:12345-192.168.202.50@tcp:101:bash.0 Request processed in 7537us (8262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330220.441283:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 177 00010000:00010000:2.0:1788330220.444424:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330220.450057:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330220.450203:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766121344 00000100:00100000:1.0:1788330220.450222:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766121344 00000100:00100000:1.0:1788330220.450298:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 45 00000100:00100000:1.0:1788330220.450311:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+57:12334:x1875199766121344:12345-192.168.202.50@tcp:35:bash.0 00000100:00100000:1.0:1788330220.450640:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7ef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+58:12334:x1875199766121344:12345-192.168.202.50@tcp:35:bash.0 Request processed in 331us (598us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788330220.450650:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 45 00000100:00100000:0.0:1788330220.545743:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330220.545827:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766121600 00000100:00100000:3.0:1788330220.545840:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766121600 00000100:00100000:3.0:1788330220.545907:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 178 00000100:00100000:3.0:1788330220.545916:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+58:12344:x1875199766121600:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:3.0:1788330220.545946:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330220.545970:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1ab3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106080 expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330220.546122:0:12916:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788330220.546389:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1ab3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106080 expref: 60 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.546419:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95d00) 00010000:00010000:3.0:1788330220.546422:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788330220.546426:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1ab3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106080 expref: 60 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.546439:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59caa00, rc 0) 00000100:00100000:3.0:1788330220.547430:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+59:12344:x1875199766121600:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1505us (1696us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1788330220.547440:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 178 00000100:00100000:0.0:1788330220.557297:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330220.557417:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766121728 00000100:00100000:2.0:1788330220.557430:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766121728 00000100:00100000:2.0:1788330220.557518:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 179 00000100:00100000:2.0:1788330220.557531:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+59:12344:x1875199766121728:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:2.0:1788330220.557672:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1ac1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.557696:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1ac1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.557712:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1ac1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.557745:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1ac8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.557753:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.557760:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.557858:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1acf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.557868:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1acf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.557875:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1acf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330220.557937:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1acf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.557952:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1ac1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.557969:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1ac1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.557977:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1ac1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.557984:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330220.557990:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1ac1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.557999:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1ac1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.558014:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:2.0:1788330220.558017:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330220.558023:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1ac1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.558030:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1ac1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.558046:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.558052:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1ac8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.558058:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.558062:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330220.558072:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.558078:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.558086:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99eec91de500) 00010000:00010000:2.0:1788330220.558088:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330220.558102:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1ac8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.558108:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1ac8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.558119:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1acf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.558124:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1acf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.558129:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1acf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.558133:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330220.558136:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1acf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.558140:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1acf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.558147:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:2.0:1788330220.558204:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330220.558215:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1acf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330220.558221:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1acf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330220.558326:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+59:12344:x1875199766121728:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 794us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330220.558335:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 179 00000100:00100000:2.0:1788330220.562579:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330220.562867:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766121984 00000100:00100000:1.0:1788330220.562883:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766121984 00000100:00100000:1.0:1788330220.562995:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 46 00000100:00100000:1.0:1788330220.563010:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+59:12344:x1875199766121984:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:1.0:1788330220.563403:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+60:12344:x1875199766121984:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 396us (839us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788330220.563412:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 46 00000100:00100000:0.0:1788330220.590871:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330220.590981:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766122240 00000100:00100000:3.0:1788330220.590994:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766122240 00000100:00100000:3.0:1788330220.591074:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 180 00000100:00100000:3.0:1788330220.591088:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+60:12347:x1875199766122240:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:3.0:1788330220.591174:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330220.591207:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1ad6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106087 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.591526:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1add lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.591546:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1add lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.591562:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1add lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.591575:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1ae4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.591600:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.591609:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.591770:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1aeb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.591780:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1aeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.591786:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1aeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330220.591796:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788330220.591899:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1add lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.591908:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1add lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.591915:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1add lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.591920:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59ca000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330220.591926:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1add lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.591933:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1add lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.591959:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:3.0:1788330220.591962:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330220.591969:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1add lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.591976:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1add lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.591990:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.591996:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1ae4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.592001:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.592006:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330220.592008:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.592014:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.592022:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99eec91de500) 00010000:00010000:3.0:1788330220.592024:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330220.592027:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1ae4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.592032:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1ae4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.592105:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1ad6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106087 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.592121:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1aeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106087 expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.594430:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:3.0:1788330220.594436:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788330220.594443:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59ca600, rc 0) 00000100:00100000:3.0:1788330220.594698:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+62:12347:x1875199766122240:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 3602us (3833us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788330220.594712:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 180 00000100:00100000:0.0:1788330220.600814:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330220.600892:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330220.600961:0:13195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766122496 00000100:00100000:3.0:1788330220.600977:0:13195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766122496 00000100:00100000:3.0:1788330220.601075:0:13195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:3.0:1788330220.601099:0:13195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+62:2411:x1875199766122496:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330220.601134:0:13195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330220.601210:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1aeb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106087 expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.601236:0:13195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:3.0:1788330220.601243:0:13195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330220.601549:0:13195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+61:2411:x1875199766122496:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 462us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330220.601558:0:13195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:1.0:1788330220.601731:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766122368 00000100:00100000:1.0:1788330220.601742:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766122368 00000100:00100000:1.0:1788330220.601783:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 181 00000100:00100000:1.0:1788330220.601791:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+61:12347:x1875199766122368:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:1.0:1788330220.601866:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1af9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.601886:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1af9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.601898:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1af9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.601940:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1af9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.601946:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1af9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.601954:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1af9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.601961:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330220.601967:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1af9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.601974:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1af9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.601982:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:1.0:1788330220.601985:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788330220.601989:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1af9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.602005:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1af9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330220.602051:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+61:12347:x1875199766122368:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 261us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330220.602058:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 181 00000100:00100000:2.0:1788330220.605845:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330220.605955:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766122752 00000100:00100000:0.0:1788330220.605969:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766122752 00000100:00100000:0.0:1788330220.606111:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 47 00000100:00100000:0.0:1788330220.606136:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc730f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+61:12347:x1875199766122752:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:0.0:1788330220.606873:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc730f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+62:12347:x1875199766122752:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 748us (1041us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788330220.606884:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 47 00000100:00100000:0.0:1788330220.749211:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330220.749298:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766123008 00000100:00100000:1.0:1788330220.749314:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766123008 00000100:00100000:1.0:1788330220.749402:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 182 00000100:00100000:1.0:1788330220.749418:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+62:12365:x1875199766123008:12345-192.168.202.50@tcp:101:cat.0 00010000:00010000:1.0:1788330220.749455:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330220.749490:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610608e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.749639:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b07 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.749660:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.749677:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330220.749694:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788330220.749840:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b00 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610608e expref: 65 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.749863:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610608e expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.749889:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:1.0:1788330220.749893:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788330220.749898:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79e00, rc 0) 00000100:00100000:1.0:1788330220.749991:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+64:12365:x1875199766123008:12345-192.168.202.50@tcp:101:cat.0 Request processed in 576us (879us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1788330220.750000:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 182 00000100:00100000:2.0:1788330220.773513:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330220.774674:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766123136 00000100:00100000:3.0:1788330220.774692:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766123136 00000100:00100000:3.0:1788330220.774853:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 183 00000100:00100000:3.0:1788330220.774868:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+64:12366:x1875199766123136:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:3.0:1788330220.774906:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330220.774937:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1b15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106095 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.775235:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1b1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.775569:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.775585:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330220.775646:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788330220.775650:0:6522:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788330220.775680:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.775718:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1b15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106095 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.775742:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1b1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106095 expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330220.775752:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:3.0:1788330220.775756:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330220.775774:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59caa00, rc 0) 00000100:00100000:3.0:1788330220.775942:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+65:12366:x1875199766123136:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1077us (2446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330220.775952:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 183 00000100:00100000:2.0:1788330220.780690:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330220.780812:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766123520 00000100:00100000:1.0:1788330220.780828:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766123520 00000100:00100000:1.0:1788330220.780896:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 48 00000100:00100000:1.0:1788330220.780906:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+65:12366:x1875199766123520:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:1.0:1788330220.781755:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+66:12366:x1875199766123520:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 845us (1075us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788330220.781766:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 48 00000100:00100000:0.0:1788330220.783749:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330220.784267:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766123648 00000100:00100000:1.0:1788330220.784281:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766123648 00000100:00100000:1.0:1788330220.784385:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:1.0:1788330220.784398:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+66:12366:x1875199766123648:12345-192.168.202.50@tcp:103:lfs.0 00010000:00010000:1.0:1788330220.784420:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788330220.784453:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1aac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106079 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.784481:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b07 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610608e expref: 65 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.784495:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd19a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106033 expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.784523:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:1.0:1788330220.784529:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330220.784673:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6da1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+63:12366:x1875199766123648:12345-192.168.202.50@tcp:103:lfs.0 Request processed in 277us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330220.784683:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:2.0:1788330220.787115:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330220.787443:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766123776 00000100:00100000:0.0:1788330220.787457:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766123776 00000100:00100000:0.0:1788330220.787589:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 184 00000100:00100000:0.0:1788330220.787603:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+63:12366:x1875199766123776:12345-192.168.202.50@tcp:58:lfs.0 00010000:00010000:0.0:1788330220.787801:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1b23 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330220.787827:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1b23 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330220.787841:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1b23 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788330220.787985:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788330220.788113:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+63:12366:x1875199766123776:12345-192.168.202.50@tcp:58:lfs.0 Request processed in 512us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330220.788124:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 184 00000100:00100000:3.0:1788330220.807899:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330220.808833:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766123904 00000100:00100000:1.0:1788330220.808851:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766123904 00000100:00100000:1.0:1788330220.809366:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 185 00000100:00100000:1.0:1788330220.809383:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+63:12368:x1875199766123904:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1788330220.809412:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330220.809442:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1b2a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610609c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.809532:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b31 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.809551:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b31 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.809565:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b31 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.809578:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.814635:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.814696:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.814829:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1b3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.814841:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.814848:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330220.814911:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788330220.814917:0:6524:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788330220.814945:0:6524:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.814958:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.814969:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b31 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.814976:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b31 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.814984:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b31 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.814991:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330220.814996:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b31 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.815015:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b31 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.815033:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:1.0:1788330220.815036:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330220.815042:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b31 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.815861:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b31 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.815884:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.815891:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b38 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.815898:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.815904:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330220.815907:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.815914:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.815927:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99eec91de500) 00010000:00010000:1.0:1788330220.815931:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330220.815935:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b38 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.815955:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.816001:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1b2a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610609c expref: 65 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.816017:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1b3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610609c expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330220.816025:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:1.0:1788330220.816028:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788330220.816030:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78a00, rc 0) 00000100:00100000:1.0:1788330220.817434:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+64:12368:x1875199766123904:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 8043us (9542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330220.817448:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 185 00000100:00100000:2.0:1788330221.468623:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc847a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792403712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788330221.468745:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788330221.470261:0:8631:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 425442106391ns, next at 426442102815ns, rc = 0 00000100:00100000:0.0:1788330221.470499:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792403712 00000100:00100000:0.0:1788330221.470511:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792403712 00000100:00100000:0.0:1788330221.470596:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788330221.470607:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792403712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788330221.470662:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788330221.470750:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792403712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 145us (2006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330221.470758:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00010000:00010000:0.0:1788330221.470784:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330221.470948:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc847a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792403712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788330221.470972:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330221.470982:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792403840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330221.471033:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788330221.472860:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330221.473503:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792403840 00000100:00100000:1.0:1788330221.473519:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792403840 00000100:00100000:1.0:1788330221.473600:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788330221.473612:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875199792403840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330221.473646:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788330221.473762:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875199792403840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (2738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330221.473770:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:1.0:1788330221.473796:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330221.474103:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792403840:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1788330221.489767:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:2.0:1788330221.489843:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:2.0:1788330221.489910:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788330221.489927:0:6501:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99eef402bcc0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788330221.489933:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99eefe422500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99eef402b6c0 00000020:00080000:2.0:1788330221.489937:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99eefe422600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99edc7d9ce00 00010000:00010000:2.0:1788330221.489999:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.490029:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.490039:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.490045:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330221.490051:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.490060:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.490092:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99eec91def00) 00010000:00010000:2.0:1788330221.490095:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330221.490102:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18ec lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.490108:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326000/0x8475908e9fd18ec lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.490144:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd18f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.490181:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd18f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.490185:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd18f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.490190:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330221.490200:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd18f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.490207:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd18f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.490217:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:2.0:1788330221.490220:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330221.490223:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd18f3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.490230:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd18f3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.490258:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1932 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330221.490627:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792403968:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788330221.490729:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330221.490842:0:13829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792403968 00000100:00100000:1.0:1788330221.490854:0:13829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792403968 00000100:00100000:1.0:1788330221.490914:0:13829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788330221.490924:0:13829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792403968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788330221.490980:0:13829:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:1.0:1788330221.491020:0:13829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a97c0ea, atime: 0x6a97c0ea, ctime: 0x6a97c0ea, blocks: 0x8 00010000:00010000:1.0:1788330221.491028:0:13829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de5f91aa/0x8475908e9fd1b46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.491045:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788330221.491050:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330221.491057:0:13829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de5f91aa/0x8475908e9fd1b46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.491074:0:13829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de5f91aa/0x8475908e9fd1b46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.491097:0:13829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de5f91aa/0x8475908e9fd1b46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.491105:0:13829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de5f91aa/0x8475908e9fd1b46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.491132:0:13829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788330221.491544:0:13829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3646:x1875199792403968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 619us (813us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788330221.491561:0:13829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:1.0:1788330221.491594:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330221.491602:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de5f91aa/0x8475908e9fd1b46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.491612:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330221.491616:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de5f91aa/0x8475908e9fd1b46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.491625:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de5f91aa/0x8475908e9fd1b46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.491643:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de5f91aa/0x8475908e9fd1b46 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.491650:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de5f91aa/0x8475908e9fd1b46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.491670:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330221.491672:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330221.491673:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788330221.491713:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99eeffd8d500/2, rc 0, transno 4294967308 00000100:00100000:1.0:1788330221.491720:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792403968:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788330221.491780:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1932 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491792:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1932 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491798:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330221.491803:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1932 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491810:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1932 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491823:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99eec91de500) 00010000:00010000:2.0:1788330221.491826:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330221.491838:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1932 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491845:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1932 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491867:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1a35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491874:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1a35 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491880:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1a35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491885:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330221.491888:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1a35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491895:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1a35 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491905:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:2.0:1788330221.491907:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330221.491910:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1a35 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491916:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1a35 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491927:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1a58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491933:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1a58 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491945:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1a58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491950:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330221.491953:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1a58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491959:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1a58 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491967:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:2.0:1788330221.491969:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330221.491972:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1a58 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491977:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1a58 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491989:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1a9e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.491995:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1a9e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.492000:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1a9e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.492004:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330221.492006:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1a9e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.492021:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1a9e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.492029:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:2.0:1788330221.492031:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330221.492034:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1a9e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.492040:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1a9e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788330221.492065:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788330221.492138:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:0.0:1788330221.695963:0:14617:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788330221.695979:0:14617:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788330221.696006:0:14617:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788330221.696014:0:14617:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788330221.792839:0:13809:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788330221.792852:0:13809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788330221.792905:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788330221.792917:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788330221.793095:0:13809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd8f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13809:1875199792404096:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788330221.793655:0:13809:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee74dd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330221.799341:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330221.799584:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766124032 00000100:00100000:0.0:1788330221.799598:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766124032 00000100:00100000:0.0:1788330221.799680:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 186 00000100:00100000:0.0:1788330221.799695:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:12380:x1875199766124032:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788330221.799746:0:6522:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788330221.799991:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:12380:x1875199766124032:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 298us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330221.799999:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 186 00000100:00100000:1.0:1788330221.800430:0:13809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd8f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13809:1875199792404096:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788330221.804325:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330221.805698:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766124160 00000100:00100000:1.0:1788330221.805715:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766124160 00000100:00100000:0.0:1788330221.805976:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 187 00000100:00100000:0.0:1788330221.805990:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+17:12380:x1875199766124160:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788330221.806124:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1b4d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.806184:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1b4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.806200:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1b4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.808878:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1b54 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.808911:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1b54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.808929:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1b54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.808987:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1b5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.808999:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809006:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330221.809336:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788330221.809342:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788330221.809363:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809379:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1b4d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809387:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1b4d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809394:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1b4d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809410:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330221.809416:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1b4d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809423:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1b4d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809439:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99eec9216d00) 00010000:00010000:0.0:1788330221.809442:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330221.809448:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1b4d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809454:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1b4d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809465:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1b54 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809471:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1b54 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809476:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1b54 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809560:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330221.809563:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1b54 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809570:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1b54 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809589:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff99eec507a400) 00010000:00010000:0.0:1788330221.809592:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330221.809595:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1b54 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809600:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1b54 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809618:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809624:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1b5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809628:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1b5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809633:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330221.809635:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1b5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809640:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1b5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809647:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:0.0:1788330221.809649:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330221.809652:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1b5b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.809657:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327800/0x8475908e9fd1b5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330221.809863:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+17:12380:x1875199766124160:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 Request processed in 3799us (5476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330221.809876:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 187 00000100:00100000:0.0:1788330221.812439:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330221.812694:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766124416 00000100:00100000:1.0:1788330221.812708:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766124416 00000100:00100000:1.0:1788330221.812782:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 188 00000100:00100000:1.0:1788330221.812806:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+17:12380:x1875199766124416:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330221.812833:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330221.812858:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1b62 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61060a3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.812999:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.813016:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.813044:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330221.813058:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788330221.813215:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.813223:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b69 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.813242:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.813249:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330221.813254:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.813263:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b69 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.813278:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:1.0:1788330221.813282:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788330221.813287:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b69 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.813293:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.813342:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1b62 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060a3 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.813354:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99eec9216d00) 00010000:00010000:1.0:1788330221.813357:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788330221.813361:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1b62 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060a3 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.813372:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79400, rc 0) 00000100:00100000:1.0:1788330221.813460:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:12380:x1875199766124416:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 656us (1033us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1788330221.813487:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 188 00000100:00100000:3.0:1788330221.815904:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330221.815972:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766124544 00000100:00100000:0.0:1788330221.815984:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766124544 00000100:00100000:0.0:1788330221.816108:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 189 00000100:00100000:0.0:1788330221.816130:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:12380:x1875199766124544:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788330221.816191:0:6522:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788330221.816339:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9758000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:12380:x1875199766124544:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 221us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330221.816347:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 189 00000100:00100000:1.0:1788330221.826666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330221.826846:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766124800 00000100:00100000:0.0:1788330221.826861:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766124800 00000100:00100000:0.0:1788330221.826980:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 190 00000100:00100000:0.0:1788330221.826994:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:12380:x1875199766124800:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330221.827038:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330221.827043:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788330221.827091:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1b1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106095 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.827122:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:0.0:1788330221.827128:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330221.827183:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1b77 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61060aa expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788330221.827732:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788330221.828076:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1b7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.828103:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1b7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.828115:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1b7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.828580:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1b77 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060aa expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.828600:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1b7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060aa expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.828608:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99eec507a400) 00010000:00010000:0.0:1788330221.828611:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330221.828614:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326800, rc 0) 00000100:00100000:0.0:1788330221.828768:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:12380:x1875199766124800:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 1775us (2116us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788330221.828777:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 190 00000100:00100000:0.0:1788330221.834471:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330221.834601:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766125056 00000100:00100000:1.0:1788330221.834616:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766125056 00000100:00100000:1.0:1788330221.834686:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 191 00000100:00100000:1.0:1788330221.834698:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc847bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:12380:x1875199766125056:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788330221.834774:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330221.834821:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1b7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060aa expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.834843:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99eec507a400) 00010000:00010000:1.0:1788330221.834856:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788330221.834882:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b8c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.834898:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b8c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.834910:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b8c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.834926:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b93 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x65f984a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.834934:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x65f984a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.834941:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x65f984a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.835012:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b8c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.835020:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b8c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.835027:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b8c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.835033:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330221.835039:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b8c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.835048:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b8c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.835058:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:1.0:1788330221.835060:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330221.835064:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b8c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.835068:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1b8c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.835075:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x65f984a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.835090:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b93 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x65f984a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.835095:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b93 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x65f984a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.835103:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330221.835106:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b93 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x65f984a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.835110:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b93 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x65f984a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.835123:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x65f984a9 (ffff99edc75ac300) 00010000:00010000:1.0:1788330221.835125:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330221.835126:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b93 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x65f984a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.835130:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1b93 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x65f984a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330221.835299:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc847bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:12380:x1875199766125056:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 601us (843us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788330221.835307:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 191 00000100:00100000:3.0:1788330221.842513:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330221.842587:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766125184 00000100:00100000:2.0:1788330221.842601:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766125184 00000100:00100000:2.0:1788330221.842673:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 192 00000100:00100000:2.0:1788330221.842685:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:12380:x1875199766125184:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330221.842716:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330221.842746:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1b9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61060b1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.842800:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1ba1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.842815:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.842831:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.842983:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1b9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060b1 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.843002:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060b1 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.843013:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99eecbb95500) 00010000:00010000:2.0:1788330221.843016:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788330221.843020:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039000, rc 0) 00000100:00100000:2.0:1788330221.843431:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:12380:x1875199766125184:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 745us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330221.843440:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 192 00000100:00100000:2.0:1788330221.849216:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330221.849888:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766125440 00000100:00100000:3.0:1788330221.849905:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766125440 00000100:00100000:3.0:1788330221.849982:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 193 00000100:00100000:3.0:1788330221.849995:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:12380:x1875199766125440:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788330221.850147:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1ba8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.850189:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.850205:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788330221.850440:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788330221.850453:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 425822301446ns, next at 426822298226ns, rc = 0 00000004:00010000:3.0:1788330221.850521:0:6523:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008fac7dae reply state 00000000b399bb52 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.850536:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1ba8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.850564:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99eecbb95500) 00010000:00010000:3.0:1788330221.850567:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788330221.850572:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788330221.850726:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:12380:x1875199766125440:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 732us (1525us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788330221.850735:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 193 00000100:00100000:2.0:1788330221.854560:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330221.854767:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766125568 00000100:00100000:3.0:1788330221.854780:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766125568 00000100:00100000:3.0:1788330221.854859:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 194 00000100:00100000:3.0:1788330221.854875:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:12380:x1875199766125568:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330221.854909:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330221.854939:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1baf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61060b8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.855019:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1baf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060b8 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.855037:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1baf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060b8 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.855060:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99eecbb95500) 00010000:00010000:3.0:1788330221.855063:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788330221.855068:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cb800, rc 0) 00000100:00100000:3.0:1788330221.855179:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:12380:x1875199766125568:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 309us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330221.855187:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 194 00000100:00100000:2.0:1788330221.859114:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330221.859289:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766125696 00000100:00100000:3.0:1788330221.859302:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766125696 00000100:00100000:3.0:1788330221.859391:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00100000:3.0:1788330221.859404:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2412:x1875199766125696:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788330221.859467:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330221.859726:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2412:x1875199766125696:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 324us (627us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788330221.859736:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00100000:2.0:1788330221.862482:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330221.862593:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766125952 00000100:00100000:3.0:1788330221.862607:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766125952 00000100:00100000:3.0:1788330221.862687:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 49 00000100:00100000:3.0:1788330221.862702:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:12380:x1875199766125952:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788330221.863060:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+23:12380:x1875199766125952:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 360us (595us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788330221.863070:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 49 00000100:00100000:1.0:1788330221.865451:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330221.865616:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766126208 00000100:00100000:2.0:1788330221.865643:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766126208 00000100:00100000:2.0:1788330221.865729:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 195 00000100:00100000:2.0:1788330221.865742:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+23:12380:x1875199766126208:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788330221.865897:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+23:12380:x1875199766126208:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 156us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330221.865905:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 195 00000100:00100000:2.0:1788330221.868645:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330221.869041:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766126336 00000100:00100000:3.0:1788330221.869054:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766126336 00000100:00100000:3.0:1788330221.869223:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 196 00000100:00100000:3.0:1788330221.869239:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+23:12380:x1875199766126336:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330221.869285:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330221.869318:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1bb6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61060bf expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.869419:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1bbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.869439:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1bbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.869467:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1bbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330221.869542:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788330221.869566:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1bbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.869602:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1bb6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060bf expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.869620:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1bbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060bf expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.869631:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99eecbb95500) 00010000:00010000:3.0:1788330221.869634:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788330221.869639:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cb200, rc 0) 00000100:00100000:3.0:1788330221.869725:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+24:12380:x1875199766126336:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 489us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330221.869733:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 196 00000100:00100000:1.0:1788330221.872476:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330221.872555:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766126464 00000100:00100000:2.0:1788330221.872575:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766126464 00000100:00100000:2.0:1788330221.872637:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 60 00000100:00100000:2.0:1788330221.872649:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2410:x1875199766126464:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330221.872676:0:8632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330221.872703:0:8632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000067128d6/0x8475908e9fd1bc4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61060c6 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788330221.872734:0:8632:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a97c0ed, blocks: 0x0 00010000:00010000:2.0:1788330221.872760:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1788330221.872765:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330221.872775:0:8632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000067128d6/0x8475908e9fd1bc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060c6 expref: 8 pid: 8632 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.872868:0:8632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000067128d6/0x8475908e9fd1bc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060c6 expref: 8 pid: 8632 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.872886:0:8632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038400, rc 0) 00000100:00100000:2.0:1788330221.872961:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2410:x1875199766126464:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 314us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330221.872969:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 60 00000100:00100000:2.0:1788330221.876559:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330221.876626:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766126720 00000100:00100000:0.0:1788330221.876638:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766126720 00000100:00100000:0.0:1788330221.876702:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 197 00000100:00100000:0.0:1788330221.876711:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+24:12380:x1875199766126720:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788330221.876886:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+24:12380:x1875199766126720:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 165us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330221.876896:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 197 00000100:00100000:3.0:1788330221.879285:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330221.879388:0:13829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766126848 00000100:00100000:2.0:1788330221.879402:0:13829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766126848 00000100:00100000:2.0:1788330221.879488:0:13829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:2.0:1788330221.879501:0:13829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec3742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:12380:x1875199766126848:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330221.879529:0:13829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330221.879566:0:13829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1bcb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61060cd expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.879620:0:13829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000067128d6/0x8475908e9fd1bc4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060c6 expref: 9 pid: 8632 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.879631:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330221.879636:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330221.879643:0:13829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1bcb lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060cd expref: 9 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.879697:0:13829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000067128d6/0x8475908e9fd1bc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060c6 expref: 9 pid: 8632 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.879715:0:13829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000067128d6/0x8475908e9fd1bc4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060c6 expref: 9 pid: 8632 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330221.879734:0:13829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13829:1875199792404224:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330221.879871:0:13829:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330221.882491:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330221.882503:0:13829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13829:1875199792404224:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330221.882535:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766126976 00000100:00100000:2.0:1788330221.882546:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766126976 00010000:00010000:3.0:1788330221.882555:0:13829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1bcb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060cd expref: 10 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.882586:0:13829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039e00, rc 0) 00010000:00010000:2.0:1788330221.882591:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000067128d6/0x8475908e9fd1bc4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060c6 expref: 10 pid: 8632 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330221.882631:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 88 00000100:00100000:2.0:1788330221.882643:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec986f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+10:2412:x1875199766126976:12345-192.168.202.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788330221.882665:0:13829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec3742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+10:12380:x1875199766126848:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 3167us (3398us total) trans 0 rc 0/0 00010000:00010000:2.0:1788330221.882673:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788330221.882681:0:13829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 61 00010000:00010000:2.0:1788330221.882707:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000067128d6/0x8475908e9fd1bc4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060c6 expref: 9 pid: 8632 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.882722:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000067128d6/0x8475908e9fd1bc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060c6 expref: 9 pid: 8632 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.882755:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000067128d6/0x8475908e9fd1bc4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060c6 expref: 9 pid: 8632 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.882771:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330221.882777:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330221.882786:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1bcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060cd expref: 8 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.882801:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1bcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060cd expref: 8 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.882859:0:8454:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1bcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060cd expref: 8 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330221.882890:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8454:1875199792404352:192.168.202.50@tcp:105: 00000100:00100000:2.0:1788330221.882982:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330221.887415:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8454:1875199792404352:192.168.202.50@tcp:105: 00010000:00010000:0.0:1788330221.887452:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330221.887572:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec986f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2412:x1875199766126976:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 4928us (5108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330221.887588:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 88 00000100:00100000:3.0:1788330221.891714:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330221.891915:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766127104 00000100:00100000:1.0:1788330221.891928:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766127104 00002000:00100000:1.0:1788330221.892087:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff99eed82d2d80 x1875199766127104/t0(0) o4->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:237/0 lens 504/0 e 0 to 0 dl 1788330232 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788330221.892100:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99eed82d2d80 with x1875199766127104 ext(0->8) 00002000:00010000:1.0:1788330221.892109:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99eed82d2d80 00000100:00100000:1.0:1788330221.892146:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:1.0:1788330221.892413:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2412:x1875199766127104:12345-192.168.202.50@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788330221.893539:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+10:2412:x1875199766127104:12345-192.168.202.50@tcp:4:lhsmtool_posix.0 Request processed in 1123us (1828us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788330221.893550:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 4 00002000:00100000:1.0:1788330221.893561:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff99eed82d2d80 x1875199766127104/t4294967315(0) o4->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:237/0 lens 504/448 e 0 to 0 dl 1788330232 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788330221.893571:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99eed82d2d80 with x1875199766127104 ext(0->8) 00002000:00010000:1.0:1788330221.893576:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99eed82d2d80 00000100:00100000:0.0:1788330221.897037:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330221.897123:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766127232 00000100:00100000:2.0:1788330221.897138:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766127232 00000100:00100000:2.0:1788330221.897368:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 198 00000100:00100000:2.0:1788330221.897391:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+24:12380:x1875199766127232:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788330221.899712:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:1.0:1788330221.899735:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1788330221.899767:0:6501:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1788330221.899793:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1788330221.899814:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788330221.900032:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+20:12380:x1875199766127232:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 Request processed in 2637us (3002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330221.900045:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 198 00000100:00100000:1.0:1788330221.900110:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792404480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788330221.900221:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330221.900372:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792404480 00000100:00100000:1.0:1788330221.900383:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792404480 00000100:00100000:1.0:1788330221.900463:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788330221.900476:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792404480:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1788330221.900569:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1788330221.900647:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788330221.900651:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788330221 00002000:00010000:1.0:1788330221.900653:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788330221.900663:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788330221 -> 1788330221 00002000:00010000:1.0:1788330221.900666:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788330221.900704:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875199792404480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 231us (484us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788330221.900712:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:1.0:1788330221.900762:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99edc8454e00/2, rc 0, transno 4294967316 00000100:00100000:1.0:1788330221.900770:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792404480:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788330221.902440:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1ba8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.902462:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1ba8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.902471:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1ba8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.902478:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59ca600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330221.902484:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1ba8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.902495:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1ba8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.902520:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99eecbb95500) 00010000:00010000:0.0:1788330221.902524:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788330221.902531:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1ba8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.902551:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1ba8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330221.905310:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330221.905407:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766127360 00000100:00100000:0.0:1788330221.905421:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766127360 00000100:00100000:0.0:1788330221.905484:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:0.0:1788330221.905497:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+10:2413:x1875199766127360:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788330221.908812:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1788330221.908833:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1788330221.909137:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2413:x1875199766127360:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 Request processed in 3632us (3829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330221.909172:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:0.0:1788330221.914920:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330221.915090:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766127616 00000100:00100000:3.0:1788330221.915103:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766127616 00000100:00100000:3.0:1788330221.915384:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 199 00000100:00100000:3.0:1788330221.915398:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:12380:x1875199766127616:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788330221.915468:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330221.915522:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1bbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060bf expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.915543:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99eecbb95500) 00010000:00010000:3.0:1788330221.915548:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330221.915588:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1bd2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.915604:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.915615:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330221.915770:0:6523:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a45e4cf6 reply state 000000003d0c5ba5 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.915783:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1bd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.915790:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99eecbb95500) 00010000:00010000:3.0:1788330221.915799:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788330221.915802:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788330221.915940:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+20:12380:x1875199766127616:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 545us (1035us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1788330221.916128:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 199 00000100:00100000:3.0:1788330221.919724:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330221.919961:0:13409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766127744 00000100:00100000:0.0:1788330221.919973:0:13409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766127744 00000100:00100000:0.0:1788330221.920068:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 64 00000100:00100000:0.0:1788330221.920093:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8457100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2412:x1875199766127744:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788330221.920737:0:13409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788330221.920748:0:13409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788330221 -> 1788330220 00002000:00010000:0.0:1788330221.920751:0:13409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788330218 00002000:00010000:0.0:1788330221.920753:0:13409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788330221 -> 1788330220 00002000:00010000:0.0:1788330221.920756:0:13409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788330221.920912:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8457100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2412:x1875199766127744:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 831us (1203us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788330221.920923:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 64 00000100:00100000:3.0:1788330221.928537:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330221.928587:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766128000 00000100:00100000:3.0:1788330221.928601:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766128000 00000100:00100000:3.0:1788330221.928673:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 200 00000100:00100000:3.0:1788330221.928686:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+20:12380:x1875199766128000:12345-192.168.202.50@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788330221.928997:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1bd9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.929022:0:12916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1ba1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060b1 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.929033:0:12916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1bd9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.929088:0:12916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060b1 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.929106:0:12916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1ba1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060b1 expref: 20 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330221.929200:0:12916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8457800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792404608:192.168.202.50@tcp:104: 00000100:00100000:3.0:1788330221.929574:0:12916:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc1088900 going to sleep for 11 seconds 00000100:00100000:1.0:1788330221.936190:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330221.952322:0:12916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8457800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792404608:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330221.952364:0:12916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1bd9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330221.952438:0:13195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766128128 00000100:00100000:2.0:1788330221.952449:0:13195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766128128 00010000:00010000:2.0:1788330221.952505:0:13195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1ba1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060b1 expref: 21 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330221.952546:0:13195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 89 00000100:00100000:2.0:1788330221.952557:0:13195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:2412:x1875199766128128:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330221.952577:0:13195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330221.952586:0:13195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1ba1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060b1 expref: 21 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.952600:0:13195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060b1 expref: 21 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.952632:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd1ba1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060b1 expref: 21 pid: 6522 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.952650:0:13195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99eecbb95500) 00010000:00010000:2.0:1788330221.952654:0:13195:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1bd9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.952666:0:13195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.952686:0:13195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1bd9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.952846:0:13195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330221.952873:0:12916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.952882:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.952939:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330221.952992:0:13195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+20:2412:x1875199766128128:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 435us (16819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330221.953002:0:13195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 89 00010000:00010000:0.0:1788330221.953025:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1bd9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.953033:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1bd9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.953041:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59caa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330221.953046:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1bd9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.953054:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1bd9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.953065:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99eecbb95500) 00010000:00010000:0.0:1788330221.953068:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788330221.953072:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1bd9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.953088:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1bd9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330221.953147:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:12380:x1875199766128000:12345-192.168.202.50@tcp:55:lhsmtool_posix.0 Request processed in 24463us (24630us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788330221.953182:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 200 00000100:00100000:0.0:1788330221.957960:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330221.958049:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766128256 00000100:00100000:3.0:1788330221.958064:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766128256 00000100:00100000:3.0:1788330221.958185:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 65 00000100:00100000:3.0:1788330221.958199:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2413:x1875199766128256:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788330221.958570:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000048b2011c/0x8475908e9fd1be0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.958603:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1bcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060cd expref: 8 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.958613:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330221.958619:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788330221.958624:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048b2011c/0x8475908e9fd1be0 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.958673:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1bcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060cd expref: 8 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330221.958692:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1bcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060cd expref: 8 pid: 13829 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330221.958709:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8456300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8437:1875199792404736:192.168.202.50@tcp:104: 00000100:00100000:3.0:1788330221.958869:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc1088b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788330221.965202:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330221.965409:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766128384 00000100:00100000:1.0:1788330221.965422:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766128384 00010000:00010000:1.0:1788330221.965479:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1bcb lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060cd expref: 9 pid: 13829 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330221.965529:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 90 00000100:00100000:1.0:1788330221.965542:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:2413:x1875199766128384:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330221.965562:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330221.965589:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1bcb lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060cd expref: 9 pid: 13829 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.965608:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1bcb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060cd expref: 9 pid: 13829 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.965642:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330221.965648:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330221.965657:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048b2011c/0x8475908e9fd1be0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.965678:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048b2011c/0x8475908e9fd1be0 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.965705:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330221.965777:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:2413:x1875199766128384:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 236us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330221.965785:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 90 00010000:00010000:0.0:1788330221.966062:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1bcb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060cd expref: 8 pid: 13829 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330221.966088:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8456300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8437:1875199792404736:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330221.966117:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048b2011c/0x8475908e9fd1be0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.966129:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048b2011c/0x8475908e9fd1be0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.966137:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048b2011c/0x8475908e9fd1be0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.966180:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000048b2011c/0x8475908e9fd1be0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.966190:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048b2011c/0x8475908e9fd1be0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.966200:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048b2011c/0x8475908e9fd1be0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.966208:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb600 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330221.966222:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048b2011c/0x8475908e9fd1be0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.966232:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048b2011c/0x8475908e9fd1be0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.966244:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048b2011c/0x8475908e9fd1be0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.966249:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048b2011c/0x8475908e9fd1be0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330221.966373:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2413:x1875199766128256:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 Request processed in 8178us (8431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330221.966379:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 65 00000100:00100000:3.0:1788330221.968967:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330221.969116:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766128640 00000100:00100000:2.0:1788330221.969130:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766128640 00000100:00100000:2.0:1788330221.969236:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 201 00000100:00100000:2.0:1788330221.969250:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:12380:x1875199766128640:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788330221.969383:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1be7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.969407:0:7832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1a2e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106056 expref: 19 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.969419:0:7832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1be7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.969469:0:7832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1a2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106056 expref: 19 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.969487:0:7832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1a2e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106056 expref: 19 pid: 12916 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330221.969504:0:7832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7832:1875199792404864:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330221.969624:0:7832:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8300 going to sleep for 11 seconds 00000100:00100000:1.0:1788330221.971973:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330221.972062:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766128768 00000100:00100000:0.0:1788330221.972089:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766128768 00010000:00010000:0.0:1788330221.972176:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1a2e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106056 expref: 20 pid: 12916 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330221.972217:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 91 00000100:00100000:0.0:1788330221.972230:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc858b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+20:2413:x1875199766128768:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330221.972247:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330221.972255:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1a2e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106056 expref: 20 pid: 12916 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.972281:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1a2e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106056 expref: 20 pid: 12916 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.972318:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:0.0:1788330221.972324:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1be7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.972334:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1be7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.972343:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1be7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330221.972365:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330221.972436:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc858b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+20:2413:x1875199766128768:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 206us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330221.972445:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 91 00010000:00010000:2.0:1788330221.972974:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1a2e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106056 expref: 19 pid: 12916 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330221.972997:0:7832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7832:1875199792404864:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330221.973026:0:7832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1be7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.973037:0:7832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1be7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.973044:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1be7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.974089:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1bee lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.974531:0:7832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1baf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060b8 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.974543:0:7832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1bee lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.974587:0:7832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1baf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060b8 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.974601:0:7832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1baf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060b8 expref: 19 pid: 6524 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330221.974616:0:7832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7832:1875199792404992:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330221.974725:0:7832:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330221.976582:0:7832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7832:1875199792404992:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330221.976617:0:7832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1bee lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330221.977799:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330221.977881:0:13195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766128896 00000100:00100000:2.0:1788330221.977893:0:13195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766128896 00010000:00010000:2.0:1788330221.977949:0:13195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1baf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060b8 expref: 20 pid: 6524 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330221.978002:0:13195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 92 00000100:00100000:2.0:1788330221.978015:0:13195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8456d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+20:2413:x1875199766128896:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330221.978035:0:13195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330221.978044:0:13195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1baf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060b8 expref: 20 pid: 6524 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.978059:0:13195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1baf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060b8 expref: 20 pid: 6524 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.978103:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1baf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060b8 expref: 20 pid: 6524 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.978121:0:13195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99eecbb95500) 00010000:00010000:2.0:1788330221.978128:0:13195:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1bee lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.978139:0:13195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1bee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.978593:0:13195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1bee lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.978661:0:13195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330221.978730:0:13195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8456d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:2413:x1875199766128896:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 716us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330221.978739:0:13195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 92 00010000:00010000:1.0:1788330221.978861:0:7832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1bee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.978870:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1bee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788330221.979019:0:7832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1788330221.979935:0:7832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1788330221.980002:0:7832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1788330221.980118:0:7832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8588e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7832:1875199792405120:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788330221.980503:0:7832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330221.980602:0:7832:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3704300 going to sleep for 11 seconds 00000100:00100000:3.0:1788330221.980655:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792405120 00000100:00100000:3.0:1788330221.980664:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792405120 00000100:00100000:3.0:1788330221.980774:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788330221.980795:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc858b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7832:x1875199792405120:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788330221.980951:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc858b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7832:x1875199792405120:12345-0@lo:1000:mdt00_003.0 Request processed in 166us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330221.980959:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788330221.981111:0:7832:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1788330221.981119:0:7832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99edc8454e00, transno 4294967316 00000100:00100000:2.0:1788330221.981145:0:7832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8588e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7832:1875199792405120:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788330221.981464:0:7832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1788330221.981547:0:7832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7832:1875199792405248:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788330221.981595:0:7832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330221.981617:0:7832:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6dd8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788330221.982040:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792405248 00000100:00100000:0.0:1788330221.982048:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792405248 00000100:00100000:0.0:1788330221.982105:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788330221.982115:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7832:x1875199792405248:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788330221.982521:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7832:x1875199792405248:12345-0@lo:1000:mdt00_003.0 Request processed in 405us (922us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788330221.982530:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788330221.982716:0:7832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7832:1875199792405248:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788330221.982768:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1bee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.982778:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1bee lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.982861:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1bee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.982884:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330221.982891:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1bee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.982900:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1bee lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.982923:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99eecbb95500) 00010000:00010000:1.0:1788330221.982926:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330221.982932:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1bee lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.982939:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1bee lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.982972:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1b23 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.982979:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1b23 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.982985:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1b23 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.982991:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330221.982994:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1b23 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.983001:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1b23 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.983021:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:1.0:1788330221.983023:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330221.983026:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1b23 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.983032:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326600/0x8475908e9fd1b23 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.983065:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1bf5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.983094:0:7832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1b3f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610609c expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.983104:0:7832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1bf5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.983526:0:7832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1b3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610609c expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.983546:0:7832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1b3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610609c expref: 22 pid: 6524 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330221.983562:0:7832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8588000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7832:1875199792405376:192.168.202.50@tcp:104: 00000100:00100000:1.0:1788330221.983701:0:7832:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3704c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788330221.988356:0:7832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8588000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7832:1875199792405376:192.168.202.50@tcp:104: 00010000:00010000:1.0:1788330221.988396:0:7832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1bf5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330221.989585:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330221.990047:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766129024 00000100:00100000:1.0:1788330221.990060:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766129024 00010000:00010000:1.0:1788330221.990608:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1b3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610609c expref: 23 pid: 6524 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330221.990705:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 93 00000100:00100000:1.0:1788330221.990720:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8479880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+23:2412:x1875199766129024:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330221.990738:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330221.990745:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1b3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610609c expref: 23 pid: 6524 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.990757:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1b3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610609c expref: 23 pid: 6524 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.990852:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1b3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610609c expref: 23 pid: 6524 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.990867:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:1.0:1788330221.990871:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1bf5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.990881:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1bf5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.990888:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1bf5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.990920:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330221.991005:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8479880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:2412:x1875199766129024:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 290us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330221.991012:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 93 00010000:00010000:2.0:1788330221.991064:0:7832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1bf5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.991071:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1bf5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.991092:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1bf5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.991097:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1bf5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.991102:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1bf5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.991123:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330221.991128:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1bf5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.991134:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1bf5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.991141:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:2.0:1788330221.991143:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330221.991145:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1bf5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.991167:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1bf5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.991176:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1be7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.991180:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1be7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.991185:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1be7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.991187:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330221.991189:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1be7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.991192:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1be7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.991205:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc75ac000) 00010000:00010000:2.0:1788330221.991207:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788330221.991209:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1be7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.991212:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1be7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330221.991389:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:12380:x1875199766128640:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 22143us (22446us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788330221.991396:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 201 00000020:00080000:2.0:1788330221.991398:0:7832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788330221.992110:0:13809:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788330221.992420:0:13809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788330221.993043:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788330221.993058:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788330221.996825:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330221.996964:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766129280 00000100:00100000:1.0:1788330221.996978:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766129280 00000100:00100000:1.0:1788330221.997070:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 50 00000100:00100000:1.0:1788330221.997092:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9241450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:12380:x1875199766129280:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788330221.997636:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788330221.997684:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1788330221.997726:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1bfc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.997748:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1bfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.997762:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1bfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.997772:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1bfc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.997778:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1bfc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.997880:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1bfc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330221.997899:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788330221.998053:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9241450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+23:12380:x1875199766129280:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 964us (1239us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788330221.998074:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 50 00000020:00080000:1.0:1788330221.998090:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788330221.998286:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330221.998293:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1bfc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.998299:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330221.998303:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1bfc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.998310:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1bfc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.998325:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99eecbb95500) 00010000:00010000:2.0:1788330221.998327:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788330221.998331:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1bfc lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.998335:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1bfc lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330221.998353:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330221.998354:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330221.998356:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330222.491565:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792405504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788330222.491689:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788330222.491947:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330222.492281:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792405504 00000100:00100000:1.0:1788330222.492297:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792405504 00000100:00100000:1.0:1788330222.492362:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788330222.492373:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792405504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788330222.492421:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788330222.492495:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792405504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330222.492502:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788330222.492675:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8455180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792405504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330223.004230:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330223.004275:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792405632:0@lo:400:kworker.0 00000100:00100000:2.0:1788330223.004502:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792405760:0@lo:400:kworker.0 00000100:00100000:2.0:1788330223.008091:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330223.008214:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792406272:0@lo:400:kworker.0 00000100:00100000:2.0:1788330223.008263:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330223.008286:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792406784:0@lo:400:kworker.0 00000100:00100000:2.0:1788330223.008313:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330223.008346:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788330223.008355:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792405888:0@lo:400:kworker.0 00000100:00100000:2.0:1788330223.008392:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330223.008414:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792406400:0@lo:400:kworker.0 00000100:00100000:2.0:1788330223.008442:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330223.008469:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792406912:0@lo:400:kworker.0 00000100:00100000:2.0:1788330223.008489:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330223.008538:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792405760 00000100:00100000:2.0:1788330223.008550:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792405760 00000100:00100000:2.0:1788330223.008613:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792406272 00000100:00100000:2.0:1788330223.008616:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792406272 00000100:00100000:2.0:1788330223.008642:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792406784 00000100:00100000:2.0:1788330223.008645:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792406784 00000100:00100000:2.0:1788330223.008661:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792405888 00000100:00100000:2.0:1788330223.008663:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792405888 00000100:00100000:2.0:1788330223.008700:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788330223.008711:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792405760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330223.008784:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792405760:12345-0@lo:400:kworker.0 Request processed in 75us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330223.008793:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788330223.009461:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788330223.009475:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792406272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330223.009529:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792406272:12345-0@lo:400:kworker.0 Request processed in 60us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330223.009536:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788330223.009549:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788330223.009556:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792406784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330223.009594:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792406784:12345-0@lo:400:kworker.0 Request processed in 38us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330223.009600:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788330223.009615:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788330223.009621:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792405888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330223.009650:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792405888:12345-0@lo:400:kworker.0 Request processed in 29us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330223.009657:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788330223.009695:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792406400 00000100:00100000:2.0:1788330223.009701:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792406400 00000100:00100000:2.0:1788330223.009743:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792406912 00000100:00100000:2.0:1788330223.009746:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792406912 00000100:00100000:2.0:1788330223.009782:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788330223.009789:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792406400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330223.012198:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792406400:12345-0@lo:400:kworker.0 Request processed in 2402us (3748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330223.012213:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788330223.012266:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788330223.012282:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792406912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330223.012322:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792406912:12345-0@lo:400:kworker.0 Request processed in 48us (3832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330223.012328:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:2.0:1788330223.012377:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330223.012383:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788330223.012388:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788330223.012444:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792405888:0@lo:400:kworker.0 00000100:00100000:2.0:1788330223.012458:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792406400:0@lo:400:kworker.0 00000100:00100000:2.0:1788330223.012470:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792406912:0@lo:400:kworker.0 00000100:00100000:2.0:1788330223.012484:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792405760:0@lo:400:kworker.0 00010000:00080000:2.0:1788330223.012501:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc8452a00 x1875199792406272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330223.012513:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792406272:0@lo:400:kworker.0 00010000:00080000:2.0:1788330223.012524:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc8453b80 x1875199792406784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330223.012532:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792406784:0@lo:400:kworker.0 00000100:00100000:3.0:1788330223.015179:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330223.015228:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792405632 00000100:00100000:1.0:1788330223.015242:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792405632 00000100:00100000:3.0:1788330223.015290:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792406016:0@lo:400:kworker.0 00000100:00100000:1.0:1788330223.015309:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1788330223.015320:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3648:x1875199792405632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330223.015360:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330223.015385:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792406528:0@lo:400:kworker.0 00000100:00100000:3.0:1788330223.015411:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330223.015449:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792407040:0@lo:400:kworker.0 00000100:00100000:3.0:1788330223.015470:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330223.015488:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788330223.015496:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792406144:0@lo:400:kworker.0 00000100:00100000:3.0:1788330223.015521:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330223.015538:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792406656:0@lo:400:kworker.0 00000100:00100000:3.0:1788330223.015558:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330223.015590:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792406016 00000100:00100000:3.0:1788330223.015594:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792406016 00000100:00100000:3.0:1788330223.015630:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788330223.015637:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792406016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330223.015701:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792406016:12345-0@lo:400:kworker.0 Request processed in 64us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330223.015709:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788330223.015763:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792406016:0@lo:400:kworker.0 00000100:00100000:3.0:1788330223.015785:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792405632:0@lo:400:kworker.0 00000100:00100000:1.0:1788330223.015787:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3648:x1875199792405632:12345-0@lo:400:kworker.0 Request processed in 469us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330223.015794:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1788330223.015985:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792406144 00000100:00100000:0.0:1788330223.015990:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792406144 00000100:00100000:0.0:1788330223.016050:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792406656 00000100:00100000:0.0:1788330223.016062:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792406656 00000100:00100000:0.0:1788330223.016106:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788330223.016114:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792406144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330223.016173:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792406144:12345-0@lo:400:kworker.0 Request processed in 60us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330223.016179:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788330223.016198:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788330223.016205:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792406656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330223.016232:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792406656:12345-0@lo:400:kworker.0 Request processed in 29us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330223.016238:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788330223.016327:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792406528 00000100:00100000:0.0:1788330223.016331:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792406528 00000100:00100000:0.0:1788330223.016476:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792407040 00000100:00100000:0.0:1788330223.016481:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792407040 00000100:00100000:0.0:1788330223.016509:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788330223.016516:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1875199792406528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330223.016554:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1875199792406528:12345-0@lo:400:kworker.0 Request processed in 39us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330223.016559:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788330223.016571:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788330223.016576:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8456680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1875199792407040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330223.016603:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8456680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1875199792407040:12345-0@lo:400:kworker.0 Request processed in 25us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330223.016608:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788330223.016673:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792406144:0@lo:400:kworker.0 00000100:00100000:0.0:1788330223.016697:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792406656:0@lo:400:kworker.0 00000100:00100000:0.0:1788330223.017600:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792406528:0@lo:400:kworker.0 00000100:00100000:0.0:1788330223.017613:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792407040:0@lo:400:kworker.0 00000100:00080000:3.0:1788330223.018737:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330223.018745:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330223.018749:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330223.333683:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330223.337919:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330223.337959:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330223.337981:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330223.337999:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330223.338034:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330223.338054:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330223.338108:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766129408 00000100:00100000:3.0:1788330223.338121:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766129408 00000100:00100000:3.0:1788330223.338201:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 395 00000100:00100000:3.0:1788330223.338214:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2411:x1875199766129408:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330223.339079:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766129536 00000100:00100000:2.0:1788330223.339089:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766129536 00000100:00100000:2.0:1788330223.339186:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766129664 00000100:00100000:2.0:1788330223.339190:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766129664 00000100:00100000:2.0:1788330223.339206:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766130048 00000100:00100000:2.0:1788330223.339209:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766130048 00000100:00100000:2.0:1788330223.339222:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766130176 00000100:00100000:2.0:1788330223.339225:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766130176 00000100:00100000:2.0:1788330223.339244:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 356 00000100:00100000:1.0:1788330223.339403:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766129792 00000100:00100000:1.0:1788330223.339408:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766129792 00000100:00100000:1.0:1788330223.339444:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766129920 00000100:00100000:1.0:1788330223.339448:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766129920 00000100:00100000:1.0:1788330223.339472:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 154 00000100:00100000:1.0:1788330223.339480:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2411:x1875199766129792:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330223.339566:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2411:x1875199766129792:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 88us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330223.339574:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 154 00000100:00100000:1.0:1788330223.339599:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 155 00000100:00100000:1.0:1788330223.339605:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefea08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2410:x1875199766129920:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330223.339631:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefea08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2410:x1875199766129920:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 27us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330223.339638:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 155 00000100:00100000:1.0:1788330223.339924:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 357 00000100:00100000:1.0:1788330223.339933:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766129664:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330223.339962:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766129664:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 31us (2003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330223.339968:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 357 00000100:00100000:1.0:1788330223.339983:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 358 00000100:00100000:1.0:1788330223.339989:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766130048:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330223.340009:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766130048:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 21us (2009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330223.340014:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 358 00000100:00100000:1.0:1788330223.340025:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 359 00000100:00100000:1.0:1788330223.340030:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766130176:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330223.340048:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766130176:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 19us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330223.340054:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 359 00000100:00100000:3.0:1788330223.341197:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2411:x1875199766129408:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 2974us (7519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330223.341213:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 395 00000100:00100000:2.0:1788330223.341355:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+23:2411:x1875199766129536:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330223.341407:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+23:2411:x1875199766129536:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 2156us (3503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330223.341416:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 356 00000100:00080000:3.0:1788330223.342093:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330223.342101:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330223.342104:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788330223.342108:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788330223.518769:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788330223.734058:0:14669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788330223.734081:0:14669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788330223.734114:0:14669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788330223.734124:0:14669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788330223.874701:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330223.874762:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766130432 00000100:00100000:1.0:1788330223.874776:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766130432 00000100:00100000:1.0:1788330223.874868:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 202 00000100:00100000:1.0:1788330223.874883:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc847b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+23:12397:x1875199766130432:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1788330223.874915:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330223.874943:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1c03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61060d4 expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.875113:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1c0a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.875131:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1c0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.875178:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1c0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330223.875195:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788330223.875345:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1c03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060d4 expref: 26 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.875364:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1c0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060d4 expref: 25 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.875375:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:1.0:1788330223.875378:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788330223.875383:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79c00, rc 0) 00000100:00100000:1.0:1788330223.875467:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc847b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+25:12397:x1875199766130432:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 586us (788us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788330223.875490:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 202 00000100:00100000:0.0:1788330223.877960:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330223.878075:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766130560 00000100:00100000:1.0:1788330223.878090:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766130560 00000100:00100000:3.0:1788330223.878201:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 203 00000100:00100000:3.0:1788330223.878219:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+25:12397:x1875199766130560:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:3.0:1788330223.878568:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1c18 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.878594:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1c18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.878609:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1c18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.878633:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1c1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.878642:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1c1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.878649:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1c1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.878770:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.878779:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.880012:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330223.880540:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.880576:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1c18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.880582:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1c18 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.880590:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1c18 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.880596:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330223.880601:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1c18 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.880611:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1c18 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.880630:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:3.0:1788330223.880634:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330223.880640:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1c18 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.880646:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1c18 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.880661:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1c1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.880666:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1c1f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.881671:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1c1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.881689:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330223.881693:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1c1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.881701:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1c1f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.881716:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99edc7580600) 00010000:00010000:3.0:1788330223.881719:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330223.881723:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1c1f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.881730:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1c1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.881752:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.881759:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c26 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.881764:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.881769:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330223.881772:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.881778:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.882117:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc7580800) 00010000:00010000:3.0:1788330223.882120:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330223.882123:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c26 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.882128:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330223.882922:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+25:12397:x1875199766130560:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 4696us (4969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330223.882936:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 203 00000100:00100000:3.0:1788330223.941085:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330223.941165:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766130816 00000100:00100000:3.0:1788330223.941180:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766130816 00000100:00100000:3.0:1788330223.941264:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 204 00000100:00100000:3.0:1788330223.941278:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+25:12400:x1875199766130816:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:3.0:1788330223.941309:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330223.941341:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c2d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61060db expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941459:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1c34 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941478:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1c34 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941492:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1c34 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941516:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1c3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941522:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1c3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941526:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1c3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941664:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1c42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941669:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1c42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941686:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1c42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330223.941696:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788330223.941788:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1c34 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941796:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1c34 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941803:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1c34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941810:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330223.941815:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1c34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941834:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1c34 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941851:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:3.0:1788330223.941855:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330223.941861:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1c34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941868:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1c34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941881:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1c3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941887:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1c3b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941891:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1c3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941894:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330223.941896:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1c3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941899:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1c3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941904:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99edc7580800) 00010000:00010000:3.0:1788330223.941906:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330223.941908:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1c3b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941918:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1c3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941958:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c2d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060db expref: 28 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941969:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1c42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060db expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.941974:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc7580600) 00010000:00010000:3.0:1788330223.941976:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788330223.941978:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cb600, rc 0) 00000100:00100000:3.0:1788330223.942069:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+27:12400:x1875199766130816:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 782us (1002us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788330223.942078:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 204 00000100:00100000:1.0:1788330223.947237:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330223.949131:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766130944 00000100:00100000:3.0:1788330223.949180:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766130944 00000100:00100000:3.0:1788330223.949268:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 205 00000100:00100000:3.0:1788330223.949282:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+27:12400:x1875199766130944:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:3.0:1788330223.949382:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.949401:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.949414:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.949477:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.949483:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c50 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.949488:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.949492:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330223.949496:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.949502:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c50 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.949513:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc7580600) 00010000:00010000:3.0:1788330223.949515:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788330223.949519:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c50 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330223.949523:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330223.949616:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+27:12400:x1875199766130944:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 338us (2395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330223.949622:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 205 00000100:00100000:1.0:1788330223.956598:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330223.956749:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766131200 00000100:00100000:3.0:1788330223.956762:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766131200 00000100:00100000:3.0:1788330223.956865:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:3.0:1788330223.956887:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc858b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+27:12400:x1875199766131200:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:3.0:1788330223.961500:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc858b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+28:12400:x1875199766131200:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 4603us (4901us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1788330223.961516:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:3.0:1788330224.004619:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330224.004754:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766131456 00000100:00100000:2.0:1788330224.004779:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766131456 00000100:00100000:2.0:1788330224.004929:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 206 00000100:00100000:2.0:1788330224.004943:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+28:11925:x1875199766131456:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1788330224.004982:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330224.005024:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1c57 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61060e2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.006024:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1c5e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.006054:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1c42 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060db expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.006075:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1c5e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.006575:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1c42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060db expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.006615:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1c42 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060db expref: 29 pid: 6523 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330224.006638:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7d69880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792407168:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330224.006910:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eecae98e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330224.011691:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7d69880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792407168:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330224.011738:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1c5e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330224.012111:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330224.012200:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766131584 00000100:00100000:1.0:1788330224.012211:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766131584 00010000:00010000:1.0:1788330224.012264:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1c42 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060db expref: 30 pid: 6523 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330224.012312:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 94 00000100:00100000:1.0:1788330224.012323:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8454a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+30:2413:x1875199766131584:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330224.012352:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330224.012361:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1c42 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060db expref: 30 pid: 6523 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.012376:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1c42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060db expref: 30 pid: 6523 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.012403:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1c42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060db expref: 30 pid: 6523 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.012423:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc7580600) 00010000:00010000:1.0:1788330224.012428:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1c5e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.012439:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1c5e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.012462:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1c5e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.012490:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330224.012565:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8454a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+29:2413:x1875199766131584:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 241us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330224.012573:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 94 00010000:00010000:2.0:1788330224.013853:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1c5e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.013872:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1c5e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330224.013901:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788330224.014318:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1c57 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060e2 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.014404:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1c5e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060e2 expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.014415:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc7580600) 00010000:00010000:2.0:1788330224.014418:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788330224.014422:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038000, rc 0) 00000100:00100000:2.0:1788330224.014534:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+29:11925:x1875199766131456:12345-192.168.202.50@tcp:101:bash.0 Request processed in 9592us (9934us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1788330224.014561:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 206 00000100:00100000:3.0:1788330224.016514:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330224.016702:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766131712 00000100:00100000:1.0:1788330224.016716:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766131712 00000100:00100000:1.0:1788330224.016883:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 207 00000100:00100000:1.0:1788330224.016896:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+29:11925:x1875199766131712:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:1.0:1788330224.016929:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330224.016957:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1c6c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61060e9 expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.017023:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1c73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.017041:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1c73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.017066:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1c73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.017284:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1c6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060e9 expref: 31 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.017306:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1c73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060e9 expref: 30 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.017324:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc7580600) 00010000:00010000:1.0:1788330224.017328:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788330224.017333:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79e00, rc 0) 00000100:00100000:1.0:1788330224.017732:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+30:11925:x1875199766131712:12345-192.168.202.50@tcp:101:bash.0 Request processed in 835us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330224.017741:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 207 00000100:00100000:1.0:1788330224.032464:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330224.033556:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766131968 00000100:00100000:3.0:1788330224.033581:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766131968 00000100:00100000:3.0:1788330224.033781:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 208 00000100:00100000:3.0:1788330224.033803:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc858a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+30:11925:x1875199766131968:12345-192.168.202.50@tcp:36:bash.0 00010000:00010000:3.0:1788330224.034235:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.034258:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.034274:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788330224.034330:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1788330224.034367:0:6524:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000064125bbc reply state 0000000092015169 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.034382:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.034390:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc7580600) 00010000:00010000:3.0:1788330224.034393:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788330224.034411:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788330224.034492:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1788330224.034662:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc858a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+34:11925:x1875199766131968:12345-192.168.202.50@tcp:36:bash.0 Request processed in 855us (2208us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788330224.036453:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 208 00000020:00080000:3.0:1788330224.036477:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788330224.039961:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330224.040562:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766132096 00000100:00100000:2.0:1788330224.040581:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766132096 00000100:00100000:2.0:1788330224.040684:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 209 00000100:00100000:2.0:1788330224.040702:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc847b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+34:11925:x1875199766132096:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1788330224.040749:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330224.041259:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1c81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61060f0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.041413:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1c81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060f0 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.041434:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1c81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060f0 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.041458:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc7580600) 00010000:00010000:2.0:1788330224.041462:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788330224.041467:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039c00, rc 0) 00000100:00100000:2.0:1788330224.041620:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc847b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+35:11925:x1875199766132096:12345-192.168.202.50@tcp:101:bash.0 Request processed in 921us (1676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330224.041630:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 209 00000100:00100000:1.0:1788330224.044965:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330224.045269:0:13829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766132224 00000100:00100000:0.0:1788330224.045283:0:13829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766132224 00000100:00100000:0.0:1788330224.045425:0:13829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 66 00000100:00100000:0.0:1788330224.045438:0:13829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc858aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:11925:x1875199766132224:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:0.0:1788330224.045464:0:13829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330224.045493:0:13829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1c88 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61060f7 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788330224.045529:0:13829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a97c0ec, atime: 0x6a97c0ea, ctime: 0x6a97c0ec, blocks: 0x8 00010000:00010000:0.0:1788330224.045562:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1788330224.045568:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330224.045579:0:13829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1c88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060f7 expref: 8 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.045601:0:13829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1c88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060f7 expref: 8 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.045618:0:13829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326000, rc 0) 00000100:00100000:0.0:1788330224.045734:0:13829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc858aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:11925:x1875199766132224:12345-192.168.202.50@tcp:101:bash.0 Request processed in 298us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330224.045742:0:13829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 66 00000100:00100000:1.0:1788330224.049145:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330224.049536:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766132352 00000100:00100000:0.0:1788330224.049556:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766132352 00002000:00010000:0.0:1788330224.049626:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1788330224.049632:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99edc858ad80 with x1875199766132352 ext(0->18446744073709551615) 00002000:00010000:0.0:1788330224.049651:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99edc858ad80. 00000100:00100000:0.0:1788330224.049697:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:0.0:1788330224.049711:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc858ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2412:x1875199766132352:12345-192.168.202.50@tcp:10:bash.0 00002000:00010000:0.0:1788330224.051741:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788330224.051753:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788330220 -> 1788330223 00002000:00010000:0.0:1788330224.051757:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788330218 -> 1788330218 00002000:00010000:0.0:1788330224.051760:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788330220 -> 1788330223 00002000:00010000:0.0:1788330224.051763:0:8444:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788330224.052238:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc858ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:2412:x1875199766132352:12345-192.168.202.50@tcp:10:bash.0 Request processed in 2521us (3108us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788330224.052252:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 5 00002000:00010000:0.0:1788330224.052259:0:8444:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1788330224.052263:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99edc858ad80 with x1875199766132352 ext(0->18446744073709551615) 00002000:00010000:0.0:1788330224.052272:0:8444:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99edc858ad80. 00000100:00100000:3.0:1788330224.183781:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330224.185528:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766132480 00000100:00100000:1.0:1788330224.185554:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766132480 00000100:00100000:1.0:1788330224.185655:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 210 00000100:00100000:1.0:1788330224.185670:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+35:12414:x1875199766132480:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:1.0:1788330224.185806:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1c8f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.185831:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1c8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.185850:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1c8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.185870:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1c96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.185878:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1c96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.185904:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1c96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186021:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1c9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186032:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1c9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186039:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1c9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788330224.186118:0:7832:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1c9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186133:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1c8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186370:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1c8f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186378:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1c8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186384:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330224.186389:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1c8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186397:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1c8f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186412:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:1.0:1788330224.186423:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330224.186429:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1c8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186435:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1c8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186452:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1c96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186457:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1c96 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186464:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1c96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186470:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330224.186473:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1c96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186480:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1c96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186488:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99edc75ac300) 00010000:00010000:1.0:1788330224.186490:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330224.186493:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1c96 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186498:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1c96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186514:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1c9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186526:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1c9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186531:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1c9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186536:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330224.186538:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1c9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186543:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1c9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186551:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc7580600) 00010000:00010000:1.0:1788330224.186553:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330224.186556:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1c9d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.186561:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1c9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330224.186700:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+35:12414:x1875199766132480:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 1030us (2932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330224.186710:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 210 00000100:00100000:1.0:1788330224.244848:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330224.245021:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766132736 00000100:00100000:3.0:1788330224.245035:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766132736 00000100:00100000:3.0:1788330224.245139:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 211 00000100:00100000:3.0:1788330224.245197:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+35:12417:x1875199766132736:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:3.0:1788330224.245229:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330224.245261:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1ca4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61060fe expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245370:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1cab lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245390:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1cab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245405:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1cab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245422:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1cb2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245429:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245436:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245599:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1cb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245610:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245617:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330224.245629:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788330224.245742:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1cab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245751:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1cab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245758:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1cab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245777:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330224.245782:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1cab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245790:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1cab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245805:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:3.0:1788330224.245808:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330224.245815:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1cab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245821:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1cab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245845:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245851:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1cb2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245858:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245864:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59caa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330224.245867:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245874:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1cb2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245882:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99edc7580800) 00010000:00010000:3.0:1788330224.245885:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330224.245888:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1cb2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245894:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1cb2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245945:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1ca4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060fe expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245961:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060fe expref: 37 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.245980:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc7580600) 00010000:00010000:3.0:1788330224.245982:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788330224.245985:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59ca600, rc 0) 00000100:00100000:3.0:1788330224.246087:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+37:12417:x1875199766132736:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 935us (1254us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788330224.246098:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 211 00000100:00100000:2.0:1788330224.251078:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330224.252262:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766132864 00000100:00100000:3.0:1788330224.252281:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766132864 00000100:00100000:3.0:1788330224.252363:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 212 00000100:00100000:3.0:1788330224.252377:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+37:12417:x1875199766132864:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:3.0:1788330224.252475:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1cc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.252496:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1c5e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060e2 expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.252508:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1cc7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.252557:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1c5e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060e2 expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.252573:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1c5e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060e2 expref: 37 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330224.252590:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8454e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792407296:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330224.253205:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec372e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330224.255363:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330224.255535:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766133120 00000100:00100000:1.0:1788330224.255547:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766133120 00000100:00100000:1.0:1788330224.255612:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:1.0:1788330224.255625:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+38:6185:x1875199766133120:12345-192.168.202.50@tcp:35:ldlm_bl.0 00000001:00080000:1.0:1788330224.256043:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967479 00000100:00100000:0.0:1788330224.256226:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8454e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792407296:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330224.256259:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1cc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330224.256508:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+40:6185:x1875199766133120:12345-192.168.202.50@tcp:35:ldlm_bl.0 Request processed in 884us (1158us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788330224.256517:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 52 00000020:00080000:1.0:1788330224.256523:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788330224.274360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330224.274515:0:13195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766133248 00000100:00100000:2.0:1788330224.274532:0:13195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766133248 00010000:00010000:2.0:1788330224.274593:0:13195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1c5e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060e2 expref: 40 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330224.274684:0:13195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 95 00000100:00100000:2.0:1788330224.274698:0:13195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec986ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+40:2412:x1875199766133248:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330224.274719:0:13195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330224.274728:0:13195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1c5e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060e2 expref: 40 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.274744:0:13195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1c5e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060e2 expref: 40 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.275009:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1c5e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060e2 expref: 40 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.275032:0:13195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc7580600) 00010000:00010000:2.0:1788330224.275039:0:13195:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1cc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.275051:0:13195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.275069:0:13195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1cc7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.275121:0:13195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330224.275253:0:13195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec986ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+39:2412:x1875199766133248:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 556us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330224.275264:0:13195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 95 00010000:00010000:1.0:1788330224.275513:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.275523:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.275579:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.275588:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1cc7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.275594:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.275600:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330224.275605:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.275612:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.275623:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc7580600) 00010000:00010000:1.0:1788330224.275626:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788330224.275630:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1cc7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.275646:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1cc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330224.275976:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+38:12417:x1875199766132864:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 23598us (24919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330224.275987:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 212 00000100:00100000:1.0:1788330224.289504:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330224.290049:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766133504 00000100:00100000:3.0:1788330224.290074:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766133504 00000100:00100000:3.0:1788330224.290287:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:3.0:1788330224.290303:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+38:12417:x1875199766133504:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:3.0:1788330224.290658:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+39:12417:x1875199766133504:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 357us (1167us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788330224.290667:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:2.0:1788330224.364921:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330224.364999:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330224.365140:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766133632 00000100:00100000:1.0:1788330224.365206:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766133632 00002000:00100000:1.0:1788330224.365299:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->7) req@ffff99edc7d69180 x1875199766133632/t0(0) o4->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:240/0 lens 496/0 e 0 to 0 dl 1788330235 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788330224.365311:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99edc7d69180 with x1875199766133632 ext(0->7) 00002000:00010000:1.0:1788330224.365319:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99edc7d69180 00000100:00100000:1.0:1788330224.365361:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:1.0:1788330224.365377:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:2410:x1875199766133632:12345-192.168.202.50@tcp:4:bash.0 00000100:00100000:1.0:1788330224.366893:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+11:2410:x1875199766133632:12345-192.168.202.50@tcp:4:bash.0 Request processed in 1504us (1974us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788330224.366913:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 6 00002000:00100000:1.0:1788330224.366927:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->7) req@ffff99edc7d69180 x1875199766133632/t4294967320(0) o4->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:240/0 lens 496/448 e 0 to 0 dl 1788330235 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788330224.366940:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99edc7d69180 with x1875199766133632 ext(0->7) 00002000:00010000:1.0:1788330224.366945:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99edc7d69180 00000100:00100000:0.0:1788330224.367438:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766133760 00000100:00100000:0.0:1788330224.367451:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766133760 00000100:00100000:0.0:1788330224.367518:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00100000:0.0:1788330224.367530:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+11:2410:x1875199766133760:12345-192.168.202.50@tcp:16:kworker.0 00000001:00080000:3.0:1788330224.369700:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:3.0:1788330224.369728:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000100:00100000:0.0:1788330224.375897:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2410:x1875199766133760:12345-192.168.202.50@tcp:16:kworker.0 Request processed in 8351us (10880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330224.375915:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00100000:2.0:1788330224.448577:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330224.449392:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766134016 00000100:00100000:0.0:1788330224.449410:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766134016 00000100:00100000:0.0:1788330224.449498:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 213 00000100:00100000:0.0:1788330224.449512:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+39:12428:x1875199766134016:12345-192.168.202.50@tcp:101:cat.0 00010000:00010000:0.0:1788330224.449548:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330224.449578:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1cce lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106105 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.449681:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1cd5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.449698:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1cd5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.449712:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1cd5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.449728:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cdc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.449735:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.449757:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.450422:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1ce3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.450435:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.450443:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330224.450455:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788330224.450557:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1cd5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.450564:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1cd5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.450571:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1cd5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.450576:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330224.450581:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1cd5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.450589:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1cd5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.450602:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:0.0:1788330224.450605:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330224.450619:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1cd5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.450626:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1cd5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.450642:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cdc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.450649:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cdc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.450655:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cdc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.450659:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330224.450662:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cdc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.450667:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cdc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.450675:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99eec91de600) 00010000:00010000:0.0:1788330224.450677:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330224.450680:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cdc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.450686:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cdc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.450743:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1cce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106105 expref: 42 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.451830:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106105 expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.451846:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc7580600) 00010000:00010000:0.0:1788330224.451849:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330224.451853:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327400, rc 0) 00000100:00100000:0.0:1788330224.451977:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+41:12428:x1875199766134016:12345-192.168.202.50@tcp:101:cat.0 Request processed in 2466us (3420us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788330224.451989:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 213 00000100:00100000:2.0:1788330224.457320:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330224.459404:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766134272 00000100:00100000:0.0:1788330224.459424:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766134272 00000100:00100000:0.0:1788330224.459516:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 54 00000100:00100000:0.0:1788330224.459530:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+41:12428:x1875199766134272:12345-192.168.202.50@tcp:35:cat.0 00000100:00100000:0.0:1788330224.459980:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+42:12428:x1875199766134272:12345-192.168.202.50@tcp:35:cat.0 Request processed in 451us (2674us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788330224.459989:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 54 00000100:00100000:1.0:1788330224.496514:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330224.497358:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766134528 00000100:00100000:0.0:1788330224.497375:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766134528 00000100:00100000:0.0:1788330224.497479:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 214 00000100:00100000:0.0:1788330224.497493:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc858a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+42:12429:x1875199766134528:12345-192.168.202.50@tcp:36:rm.0 00010000:00010000:0.0:1788330224.497584:0:12916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788330224.497626:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1c81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060f0 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.497656:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1ce3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106105 expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.497690:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1cb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060fe expref: 40 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.497704:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1c73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060e9 expref: 39 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.497716:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc7580600) 00010000:00010000:0.0:1788330224.497722:0:12916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330224.497753:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1cf1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.497782:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1cf1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.497796:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1cf1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.497814:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cf8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.497822:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.497828:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.497933:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1cff lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.497942:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1cff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.497956:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1cff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788330224.498947:0:12916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1788330224.498963:0:12916:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 428470811648ns, next at 429470808430ns, rc = 0 00010000:00010000:0.0:1788330224.499031:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1d06 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.499045:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1d06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.499066:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1d06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.499076:0:12916:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1d06 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.499084:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1d06 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.500307:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1d06 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.500347:0:12916:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330224.500385:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1cff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.500393:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1cff lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.500400:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1cff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.500421:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330224.500426:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1cff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.500434:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1cff lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.500453:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc7580600) 00010000:00010000:0.0:1788330224.500457:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788330224.500463:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1cff lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.500469:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1cff lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.500497:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1cf1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.500503:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1cf1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.500509:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1cf1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.500514:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330224.500517:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1cf1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.500522:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1cf1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.500541:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:0.0:1788330224.500543:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330224.500546:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1cf1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.500552:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1cf1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788330224.500564:0:12916:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000009433af7 reply state 00000000aa6d0f45 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.500577:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cf8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.500585:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99eec91de600) 00010000:00010000:0.0:1788330224.500587:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788330224.500591:0:12916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788330224.500741:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc858a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+40:12429:x1875199766134528:12345-192.168.202.50@tcp:36:rm.0 Request processed in 3242us (4237us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788330224.500753:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 214 00010000:00010000:2.0:1788330224.501525:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330224.501540:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1d06 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.501550:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327600 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330224.501554:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1d06 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.501562:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1d06 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.501578:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc7580600) 00010000:00010000:2.0:1788330224.501581:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788330224.501585:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1d06 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.501591:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1d06 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.501609:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330224.501611:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330224.501612:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330224.540670:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330224.584270:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330224.584395:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766134784 00000100:00100000:1.0:1788330224.584423:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766134784 00000100:00100000:1.0:1788330224.584509:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 215 00000100:00100000:1.0:1788330224.584520:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+40:12435:x1875199766134784:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:1.0:1788330224.584555:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330224.584584:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1d0d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610610c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.584729:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1d14 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.584746:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1d14 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.584760:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1d14 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.584779:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1d1b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.584787:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1d1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.584794:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1d1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788330224.585266:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788330224.585454:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1d22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.585469:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1d22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.585493:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1d22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.585541:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1d14 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.585550:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1d14 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.585557:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1d14 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.585563:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330224.585569:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1d14 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.585578:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1d14 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.585593:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:1.0:1788330224.585597:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330224.585603:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1d14 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.585610:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1d14 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788330224.585625:0:6522:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003fab9489 reply state 00000000c5dd649d transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1d1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.585638:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1d1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.585651:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99eec91de600) 00010000:00010000:1.0:1788330224.585654:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788330224.585658:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788330224.585701:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1d0d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610610c expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.585716:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1d22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610610c expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.585723:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75ac300) 00010000:00010000:1.0:1788330224.585726:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788330224.585728:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79600, rc 0) 00000100:00100000:1.0:1788330224.585835:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+43:12435:x1875199766134784:12345-192.168.202.50@tcp:101:bash.0 Request processed in 1315us (1579us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788330224.585844:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 215 00000100:00100000:3.0:1788330224.593727:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330224.593872:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766134912 00000100:00100000:0.0:1788330224.593887:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766134912 00000100:00100000:0.0:1788330224.593983:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 68 00000100:00100000:0.0:1788330224.593995:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2410:x1875199766134912:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:0.0:1788330224.594021:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330224.594049:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd1d30 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106113 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788330224.594099:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330224.594183:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=428s v=(0 0) 00010000:00010000:0.0:1788330224.594189:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330224.594201:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd1d30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106113 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.594233:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd1d30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106113 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.594250:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327000, rc 0) 00000100:00100000:0.0:1788330224.594330:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2410:x1875199766134912:12345-192.168.202.50@tcp:101:bash.0 Request processed in 336us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330224.594337:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 68 00000100:00100000:2.0:1788330224.599772:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330224.599888:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766135040 00000100:00100000:0.0:1788330224.599902:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766135040 00000100:00100000:0.0:1788330224.599995:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 69 00000100:00100000:0.0:1788330224.600006:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:12435:x1875199766135040:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:0.0:1788330224.600031:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330224.600078:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1d37 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610611a expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.600123:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd1d30 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106113 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.600130:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330224.600134:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330224.600139:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1d37 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610611a expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.600230:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd1d30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106113 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.600243:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd1d30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106113 expref: 9 pid: 8437 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330224.600257:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8478000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1875199792407424:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330224.600358:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330224.602858:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330224.602939:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766135168 00000100:00100000:1.0:1788330224.602952:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766135168 00010000:00010000:1.0:1788330224.603007:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd1d30 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106113 expref: 10 pid: 8437 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330224.603183:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 96 00000100:00100000:3.0:1788330224.603198:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8457800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+10:2413:x1875199766135168:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330224.603216:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330224.603330:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd1d30 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106113 expref: 10 pid: 8437 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.603343:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd1d30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106113 expref: 10 pid: 8437 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.603369:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330224.603373:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330224.603380:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1d37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610611a expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.603404:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1d37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610611a expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.603446:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1d37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610611a expref: 10 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330224.603462:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8456d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6507:1875199792407552:192.168.202.50@tcp:105: 00000100:00100000:3.0:1788330224.603574:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec372e6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788330224.603690:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f8949cf/0x8475908e9fd1d30 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106113 expref: 10 pid: 8437 timeout: 528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330224.603708:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8478000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8440:1875199792407424:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330224.603738:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1d37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610611a expref: 9 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.603750:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326c00, rc 0) 00000100:00100000:0.0:1788330224.603786:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:12435:x1875199766135040:12345-192.168.202.50@tcp:101:bash.0 Request processed in 3781us (4031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330224.603794:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 69 00000100:00100000:1.0:1788330224.607557:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8456d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6507:1875199792407552:192.168.202.50@tcp:105: 00010000:00010000:1.0:1788330224.607600:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330224.607689:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8457800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2413:x1875199766135168:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 4494us (4841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330224.607706:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 96 00000100:00100000:1.0:1788330224.613577:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330224.613737:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766135424 00000100:00100000:0.0:1788330224.613753:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766135424 00000100:00100000:0.0:1788330224.613845:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00100000:0.0:1788330224.613859:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+43:12435:x1875199766135424:12345-192.168.202.50@tcp:35:bash.0 00000100:00100000:0.0:1788330224.614987:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+44:12435:x1875199766135424:12345-192.168.202.50@tcp:35:bash.0 Request processed in 1122us (1421us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1788330224.615000:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00100000:3.0:1788330224.799983:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330224.800113:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766135552 00000100:00100000:0.0:1788330224.800128:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766135552 00000100:00100000:0.0:1788330224.800263:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 216 00000100:00100000:0.0:1788330224.800275:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec933bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+44:12451:x1875199766135552:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330224.800307:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330224.800335:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1d3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106121 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.800416:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1d45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.800433:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1d45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.800446:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1d45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330224.800508:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788330224.800513:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788330224.800539:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1d45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.800569:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1d3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106121 expref: 46 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.800589:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1d45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106121 expref: 45 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.800614:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:0.0:1788330224.800617:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788330224.800621:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327400, rc 0) 00000100:00100000:0.0:1788330224.800714:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec933bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+45:12451:x1875199766135552:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 441us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330224.800722:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 216 00000100:00100000:3.0:1788330224.807677:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330224.807874:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766135808 00000100:00100000:0.0:1788330224.807890:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766135808 00000100:00100000:0.0:1788330224.807977:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 217 00000100:00100000:0.0:1788330224.807991:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+45:12451:x1875199766135808:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330224.808020:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330224.808047:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1d4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106128 expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.808244:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1d53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.808261:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1d53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.808276:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1d53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330224.808292:0:12916:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788330224.808643:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1d4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106128 expref: 48 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.808687:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1d53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106128 expref: 47 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.808698:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75ac300) 00010000:00010000:0.0:1788330224.808701:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330224.808706:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326200, rc 0) 00000100:00100000:0.0:1788330224.809123:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+47:12451:x1875199766135808:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1132us (1458us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1788330224.809134:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 217 00000100:00100000:3.0:1788330224.825529:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330224.825666:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766135936 00000100:00100000:0.0:1788330224.825681:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766135936 00000100:00100000:0.0:1788330224.825784:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:0.0:1788330224.825798:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8454e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+47:2410:x1875199766135936:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330224.825817:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330224.825850:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1d53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106128 expref: 47 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.825876:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75ac300) 00010000:00010000:0.0:1788330224.825882:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330224.825958:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8454e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+46:2410:x1875199766135936:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 164us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330224.825966:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:3.0:1788330224.849301:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330224.849428:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766136192 00000100:00100000:2.0:1788330224.849441:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766136192 00000100:00100000:2.0:1788330224.849523:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 218 00000100:00100000:2.0:1788330224.849536:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+46:12451:x1875199766136192:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330224.849584:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330224.849611:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1d61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610612f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.849756:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1d68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.849838:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1d68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.849853:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1d68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330224.849869:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788330224.850003:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1d61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610612f expref: 49 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.850026:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1d68 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610612f expref: 48 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.850036:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75ac300) 00010000:00010000:2.0:1788330224.850039:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788330224.850043:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039a00, rc 0) 00000100:00100000:2.0:1788330224.850137:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+48:12451:x1875199766136192:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 602us (850us total) trans 4294967488 rc 0/0 00000100:00100000:2.0:1788330224.851301:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 218 00000100:00100000:3.0:1788330224.863418:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330224.863544:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766136320 00000100:00100000:2.0:1788330224.863562:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766136320 00000100:00100000:2.0:1788330224.863643:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 70 00000100:00100000:2.0:1788330224.863673:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2413:x1875199766136320:12345-192.168.202.50@tcp:1:lfs.0 00010000:00010000:2.0:1788330224.863746:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1d76 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.863789:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1d37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610611a expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.863799:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330224.863803:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788330224.863809:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1d76 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.863858:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1d37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610611a expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.863875:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1d37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610611a expref: 8 pid: 8440 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330224.863894:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7d69500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1875199792407680:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330224.864025:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeccff7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788330224.868473:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7d69500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1875199792407680:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330224.868522:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1d76 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330224.878559:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330224.884525:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766136448 00000100:00100000:0.0:1788330224.884553:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766136448 00002000:00100000:1.0:1788330224.884779:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff99edc8455c00 x1875199766136448/t0(0) o4->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:240/0 lens 504/0 e 0 to 0 dl 1788330235 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788330224.884796:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99edc8455c00 with x1875199766136448 ext(0->8) 00010000:00010000:1.0:1788330224.884807:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1d37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610611a expref: 9 pid: 8440 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.884829:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1d37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610611a expref: 9 pid: 8440 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788330224.884837:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99edc8455c00 00000100:00100000:1.0:1788330224.884888:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:1.0:1788330224.884903:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:2412:x1875199766136448:12345-192.168.202.50@tcp:4:lfs.0 00000100:00100000:1.0:1788330224.886749:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+11:2412:x1875199766136448:12345-192.168.202.50@tcp:4:lfs.0 Request processed in 1837us (8198us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788330224.886823:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 3 00002000:00100000:1.0:1788330224.886835:0:8444:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff99edc8455c00 x1875199766136448/t4294967309(0) o4->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:240/0 lens 504/448 e 0 to 0 dl 1788330235 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788330224.886843:0:8444:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99edc8455c00 with x1875199766136448 ext(0->8) 00010000:00010000:1.0:1788330224.886852:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1d37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610611a expref: 11 pid: 8440 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.886868:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1d37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610611a expref: 11 pid: 8440 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788330224.886874:0:8444:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99edc8455c00 00000001:00080000:3.0:1788330224.889664:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1788330224.889691:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1788330224.892579:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330224.892659:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766136576 00000100:00100000:0.0:1788330224.892689:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766136576 00010000:00010000:0.0:1788330224.892744:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1d37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610611a expref: 7 pid: 8440 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330224.892801:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 97 00000100:00100000:0.0:1788330224.892813:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8454700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2413:x1875199766136576:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330224.892831:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788330224.892856:0:8454:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788330224.892859:0:8454:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788330224 00002000:00010000:0.0:1788330224.892862:0:8454:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788330224 00002000:00010000:0.0:1788330224.892864:0:8454:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788330224 00002000:00010000:0.0:1788330224.892867:0:8454:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788330224.892874:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1d37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610611a expref: 7 pid: 8440 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.892892:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1d37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610611a expref: 7 pid: 8440 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.892924:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009536b25f/0x8475908e9fd1d37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610611a expref: 7 pid: 8440 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.892944:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788330224.892950:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788330224.892957:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1d76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.892968:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1d76 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330224.893019:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330224.893089:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1d76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.893112:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1d76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330224.893147:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8454700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+6:2413:x1875199766136576:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 335us (581us total) trans 0 rc 0/0 00010000:00010000:2.0:1788330224.893148:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1d76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.893184:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1d76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330224.893192:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 97 00010000:00010000:2.0:1788330224.893193:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1d76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.893200:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038a00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330224.893206:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1d76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.893216:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1d76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.893230:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1d76 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330224.893238:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094c57825/0x8475908e9fd1d76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330224.893313:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2413:x1875199766136320:12345-192.168.202.50@tcp:1:lfs.0 Request processed in 29644us (29912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330224.893323:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 70 00000100:00100000:0.0:1788330224.903354:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330224.906659:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766136832 00000100:00100000:3.0:1788330224.906691:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766136832 00000100:00100000:3.0:1788330224.906793:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 56 00000100:00100000:3.0:1788330224.906809:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9240c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+48:12451:x1875199766136832:12345-192.168.202.50@tcp:35:lfs.0 00000004:00010000:3.0:1788330224.906916:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1d68 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610612f expref: 48 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788330224.907406:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788330224.907470:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1788330224.907896:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:3.0:1788330224.907947:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1d7d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.907969:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1d22 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610610c expref: 52 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.907980:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1d7d lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.908035:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1d22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610610c expref: 52 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.908096:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1d22 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610610c expref: 52 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330224.908116:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8455500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1875199792407808:192.168.202.50@tcp:104: 00000100:00100000:3.0:1788330224.908819:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec372e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788330224.917069:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330224.917145:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766136960 00000100:00100000:3.0:1788330224.917183:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766136960 00010000:00010000:3.0:1788330224.917254:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1d22 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610610c expref: 53 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330224.917623:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 98 00000100:00100000:3.0:1788330224.917637:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8479c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+53:2412:x1875199766136960:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330224.917658:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330224.917667:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1d22 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610610c expref: 53 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.917705:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1d22 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610610c expref: 53 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.917737:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75ac300) 00010000:00010000:3.0:1788330224.917743:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1d7d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.917754:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1d7d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.917762:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1d7d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.917788:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330224.917943:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8479c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+53:2412:x1875199766136960:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 308us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330224.917952:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 98 00010000:00010000:1.0:1788330224.918530:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1d22 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610610c expref: 52 pid: 6522 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330224.918554:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8455500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1875199792407808:192.168.202.50@tcp:104: 00010000:00010000:1.0:1788330224.918587:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1d7d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.918597:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1d7d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.918603:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1d7d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788330224.918764:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:1.0:1788330224.920740:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1788330224.920960:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8588700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875199792407936:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788330224.921080:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330224.921654:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792407936 00000100:00100000:1.0:1788330224.921656:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3704c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788330224.921666:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792407936 00000100:00100000:0.0:1788330224.921748:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788330224.921761:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc858bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6526:x1875199792407936:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788330224.921885:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc858bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6526:x1875199792407936:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 127us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330224.921894:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788330224.922537:0:6526:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:1.0:1788330224.922545:0:6526:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:1.0:1788330224.922565:0:6526:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99eeffd8d500, transno 4294967308 00000100:00100000:1.0:1788330224.922588:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8588700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875199792407936:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788330224.922747:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:1.0:1788330224.922815:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8588700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875199792408064:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788330224.922860:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330224.922887:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3704cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330224.922913:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792408064 00000100:00100000:0.0:1788330224.922920:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792408064 00000100:00100000:0.0:1788330224.922965:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788330224.922976:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6526:x1875199792408064:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788330224.923253:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8588700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1875199792408064:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788330224.923304:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1788330224.923345:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1d7d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.923357:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1d7d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.923365:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1d7d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.923371:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330224.923391:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1d7d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.923401:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1d7d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.923423:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75ac300) 00010000:00010000:3.0:1788330224.923427:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788330224.923432:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1d7d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330224.923440:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1d7d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788330224.923554:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788330224.923630:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1788330224.923644:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 428895493077ns, next at 429895490384ns, rc = 0 00000001:00080000:3.0:1788330224.923651:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:3.0:1788330224.923679:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75ac300) 00010000:00010000:3.0:1788330224.923683:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788330224.923691:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1d68 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610612f expref: 56 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330224.923886:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9240c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+55:12451:x1875199766136832:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 17080us (20550us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788330224.923896:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 56 00000020:00080000:3.0:1788330224.923902:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788330224.928589:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330224.928664:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766137088 00000100:00100000:1.0:1788330224.928677:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766137088 00000100:00100000:1.0:1788330224.928764:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 219 00000100:00100000:1.0:1788330224.928777:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+55:12451:x1875199766137088:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1788330224.928813:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330224.928846:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1d84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106136 expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.928920:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1d84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106136 expref: 56 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.928934:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1d84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106136 expref: 56 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330224.928953:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:1.0:1788330224.928956:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330224.928959:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79e00, rc 0) 00000100:00100000:1.0:1788330224.929035:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+56:12451:x1875199766137088:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 261us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330224.929042:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 219 00000100:00100000:0.0:1788330224.929918:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6526:x1875199792408064:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 6934us (7047us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788330224.929936:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788330224.940010:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330224.940903:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766137344 00000100:00100000:0.0:1788330224.940920:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766137344 00000100:00100000:0.0:1788330224.941040:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00100000:0.0:1788330224.941063:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+56:12451:x1875199766137344:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:0.0:1788330224.941670:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+57:12451:x1875199766137344:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 616us (1674us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788330224.941695:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00100000:2.0:1788330225.041584:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330225.041724:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766137472 00000100:00100000:0.0:1788330225.041740:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766137472 00000100:00100000:0.0:1788330225.041855:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 220 00000100:00100000:0.0:1788330225.041869:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+57:12461:x1875199766137472:12345-192.168.202.50@tcp:34:lfs.0 00010000:00010000:0.0:1788330225.041984:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1d8b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042006:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1d8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042025:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1d8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042040:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1d92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042061:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1d92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042069:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1d92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788330225.042109:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788330225.042231:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1d99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042241:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1d99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042249:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1d99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788330225.042331:0:12916:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1d99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042348:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1d8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042356:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1d8b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042364:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1d8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042371:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330225.042376:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1d8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042384:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1d8b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042399:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:0.0:1788330225.042402:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330225.042409:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1d8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042415:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1d8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042432:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1d92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042438:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1d92 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042453:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1d92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042459:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330225.042462:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1d92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042469:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1d92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042478:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99eec91de600) 00010000:00010000:0.0:1788330225.042480:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330225.042484:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1d92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042490:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327000/0x8475908e9fd1d92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042500:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1d99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042507:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1d99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042513:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1d99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042518:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330225.042521:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1d99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042538:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1d99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042547:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:0.0:1788330225.042549:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330225.042553:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1d99 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.042559:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327e00/0x8475908e9fd1d99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330225.042686:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+57:12461:x1875199766137472:12345-192.168.202.50@tcp:34:lfs.0 Request processed in 818us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330225.042696:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 220 00000100:00100000:1.0:1788330225.051445:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792408192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788330225.051549:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330225.051640:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792408192 00000100:00100000:1.0:1788330225.051649:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792408192 00000100:00100000:1.0:1788330225.051716:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788330225.051729:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792408192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788330225.051762:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42323648 pending 0 free 3923525632 avail 3691974656 00000100:00100000:1.0:1788330225.051813:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792408192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330225.051835:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1788330225.051864:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330225.051904:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792408192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330225.052038:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788330225.052062:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792408320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330225.052097:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330225.052129:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792408320 00000100:00100000:2.0:1788330225.052134:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792408320 00000100:00100000:2.0:1788330225.052198:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788330225.052205:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792408320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788330225.052218:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42323648 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1788330225.052249:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792408320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330225.052256:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1788330225.052261:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788330225.052279:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:2.0:1788330225.052285:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:2.0:1788330225.052309:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792408320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330225.052564:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792408448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330225.052599:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330225.052746:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792408448 00000100:00100000:0.0:1788330225.052751:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792408448 00000100:00100000:0.0:1788330225.052794:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788330225.052802:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792408448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330225.052835:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788330225.055834:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792408448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3016us (3217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330225.055852:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788330225.056041:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792408448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330225.082862:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330225.083005:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766137728 00000100:00100000:2.0:1788330225.083017:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766137728 00000100:00100000:2.0:1788330225.083098:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 221 00000100:00100000:2.0:1788330225.083118:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+57:12464:x1875199766137728:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330225.083182:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330225.083210:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1da0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610613d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083429:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1da7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083444:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1da7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083456:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1da7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083464:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd1dae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083469:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd1dae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083472:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd1dae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083675:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1db5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083681:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1db5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083687:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1db5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330225.083703:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788330225.083795:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1da7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083803:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1da7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083811:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1da7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083818:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330225.083824:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1da7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083832:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1da7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083845:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:2.0:1788330225.083848:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330225.083853:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1da7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083858:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1da7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083870:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd1dae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083873:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd1dae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083877:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd1dae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083887:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330225.083889:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd1dae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083893:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd1dae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083897:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99eec91de600) 00010000:00010000:2.0:1788330225.083899:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330225.083901:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd1dae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083905:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd1dae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083941:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd1da0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610613d expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083951:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1db5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610613d expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.083956:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:2.0:1788330225.083958:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330225.083960:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038200, rc 0) 00000100:00100000:2.0:1788330225.084092:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+59:12464:x1875199766137728:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 975us (1241us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1788330225.084101:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 221 00000100:00100000:3.0:1788330225.091505:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330225.092608:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766137856 00000100:00100000:1.0:1788330225.092628:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766137856 00000100:00100000:1.0:1788330225.092857:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 222 00000100:00100000:1.0:1788330225.092872:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+59:12464:x1875199766137856:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:1.0:1788330225.092979:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1dc3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.093003:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.093019:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.093092:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.093102:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1dc3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.093110:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.093117:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330225.093124:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.093133:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1dc3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.093218:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:1.0:1788330225.093222:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788330225.093626:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1dc3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.093637:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1dc3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330225.093831:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+59:12464:x1875199766137856:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 959us (2339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330225.093842:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 222 00000100:00100000:2.0:1788330225.096544:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330225.096847:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766138112 00000100:00100000:3.0:1788330225.096861:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766138112 00000100:00100000:3.0:1788330225.096951:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 58 00000100:00100000:3.0:1788330225.096966:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+59:12464:x1875199766138112:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:3.0:1788330225.097526:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+60:12464:x1875199766138112:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 560us (997us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788330225.097537:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 58 00000100:00100000:3.0:1788330225.179622:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330225.179863:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766138368 00000100:00100000:1.0:1788330225.179879:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766138368 00000100:00100000:1.0:1788330225.179974:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 223 00000100:00100000:1.0:1788330225.179987:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+60:12474:x1875199766138368:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:1.0:1788330225.180028:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330225.180032:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788330225.180099:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1d45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106121 expref: 60 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.180126:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:1.0:1788330225.180132:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788330225.180389:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1dca lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106144 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.180648:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1dd1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.180686:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1db5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610613d expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.180697:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1dd1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.180749:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1db5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610613d expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.180765:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1db5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610613d expref: 60 pid: 6524 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330225.180784:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8589f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1875199792408576:192.168.202.50@tcp:104: 00000100:00100000:1.0:1788330225.180982:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3704e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788330225.186037:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8589f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1875199792408576:192.168.202.50@tcp:104: 00010000:00010000:1.0:1788330225.186105:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1dd1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330225.187019:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330225.187131:0:13195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766138496 00000100:00100000:2.0:1788330225.187143:0:13195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766138496 00010000:00010000:2.0:1788330225.187226:0:13195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1db5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610613d expref: 61 pid: 6524 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330225.187279:0:13195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 99 00000100:00100000:2.0:1788330225.187290:0:13195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8456680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+61:2413:x1875199766138496:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330225.187308:0:13195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330225.187317:0:13195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1db5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610613d expref: 61 pid: 6524 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.187332:0:13195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1db5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610613d expref: 61 pid: 6524 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.187361:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038200/0x8475908e9fd1db5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610613d expref: 61 pid: 6524 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.187382:0:13195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:2.0:1788330225.187389:0:13195:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1dd1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.187400:0:13195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1dd1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.187409:0:13195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1dd1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.187451:0:13195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330225.187537:0:13195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8456680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+60:2413:x1875199766138496:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 247us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330225.187562:0:13195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 99 00010000:00010000:0.0:1788330225.187761:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1dd1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.187771:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1dd1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330225.187810:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788330225.187997:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd1dca lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106144 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.188015:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1dd1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106144 expref: 60 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.188024:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:0.0:1788330225.188027:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788330225.188030:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79600, rc 0) 00000100:00100000:0.0:1788330225.188073:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+60:12474:x1875199766138368:12345-192.168.202.50@tcp:101:bash.0 Request processed in 8090us (8469us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788330225.188081:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 223 00000100:00100000:2.0:1788330225.191646:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330225.191752:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766138624 00000100:00100000:3.0:1788330225.191769:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766138624 00000100:00100000:3.0:1788330225.191851:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 224 00000100:00100000:3.0:1788330225.191867:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+60:12474:x1875199766138624:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:3.0:1788330225.191905:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330225.191934:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1ddf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610614b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330225.191984:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1de6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330225.192005:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1de6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330225.192022:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1de6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330225.192373:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1ddf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610614b expref: 62 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330225.192407:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1de6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610614b expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330225.192419:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:3.0:1788330225.192423:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788330225.192428:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59caa00, rc 0) 00000100:00100000:3.0:1788330225.192569:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+61:12474:x1875199766138624:12345-192.168.202.50@tcp:101:bash.0 Request processed in 704us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330225.192578:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 224 00000100:00100000:3.0:1788330225.196140:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330225.197035:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766138880 00000100:00100000:1.0:1788330225.197062:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766138880 00000100:00100000:1.0:1788330225.197262:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 225 00000100:00100000:1.0:1788330225.197276:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+61:12474:x1875199766138880:12345-192.168.202.50@tcp:36:bash.0 00010000:00010000:1.0:1788330225.197603:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064000/0x8475908e9fd1ded lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.197629:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064000/0x8475908e9fd1ded lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.197665:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064000/0x8475908e9fd1ded lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788330225.197719:0:7832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:1.0:1788330225.197746:0:7832:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002479d01d reply state 00000000fa8f718d transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064000/0x8475908e9fd1ded lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.197760:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064000/0x8475908e9fd1ded lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.197769:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:1.0:1788330225.197771:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788330225.197776:0:7832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788330225.197902:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+64:12474:x1875199766138880:12345-192.168.202.50@tcp:36:bash.0 Request processed in 629us (1781us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1788330225.197910:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 225 00000020:00080000:1.0:1788330225.197915:0:7832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788330225.200723:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330225.201055:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766139008 00000100:00100000:2.0:1788330225.201072:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766139008 00000100:00100000:2.0:1788330225.201182:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 226 00000100:00100000:2.0:1788330225.201196:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+64:12474:x1875199766139008:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1788330225.201465:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330225.201499:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd1df4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106152 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.201646:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1dfb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.201668:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1dd1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106144 expref: 65 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.201680:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1dfb lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.201734:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1dd1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106144 expref: 65 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.201752:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1dd1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106144 expref: 65 pid: 6523 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330225.201770:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7d68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792408704:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330225.202005:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeccff7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788330225.205398:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330225.205575:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7d68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792408704:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330225.205618:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1dfb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330225.205755:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766139136 00000100:00100000:1.0:1788330225.205766:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766139136 00010000:00010000:1.0:1788330225.205825:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1dd1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106144 expref: 66 pid: 6523 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330225.205862:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 100 00000100:00100000:1.0:1788330225.205873:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8478700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+66:2413:x1875199766139136:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330225.205892:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330225.205901:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1dd1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106144 expref: 66 pid: 6523 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.205939:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1dd1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106144 expref: 66 pid: 6523 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.205967:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd1dd1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106144 expref: 66 pid: 6523 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.205986:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:1.0:1788330225.205991:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1dfb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.206001:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1dfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.206010:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1dfb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.206044:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330225.206136:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8478700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+65:2413:x1875199766139136:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 263us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330225.206144:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 100 00010000:00010000:2.0:1788330225.206418:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1dfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.206428:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1dfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330225.206506:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788330225.206511:0:6522:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330225.206537:0:6522:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1dfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.206584:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038a00/0x8475908e9fd1df4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106152 expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.206602:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1dfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106152 expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.206612:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:2.0:1788330225.206616:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330225.206620:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039a00, rc 0) 00000100:00100000:2.0:1788330225.206659:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+64:12474:x1875199766139008:12345-192.168.202.50@tcp:101:bash.0 Request processed in 5467us (5958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330225.206668:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 226 00000100:00100000:3.0:1788330225.210255:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330225.210525:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766139392 00000100:00100000:2.0:1788330225.210544:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766139392 00000100:00100000:2.0:1788330225.210629:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00100000:2.0:1788330225.210663:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+64:12474:x1875199766139392:12345-192.168.202.50@tcp:35:bash.0 00000100:00100000:2.0:1788330225.210996:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+65:12474:x1875199766139392:12345-192.168.202.50@tcp:35:bash.0 Request processed in 336us (757us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788330225.211005:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00100000:3.0:1788330225.284355:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330225.284539:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766139520 00000100:00100000:0.0:1788330225.284554:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766139520 00000100:00100000:0.0:1788330225.284639:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 227 00000100:00100000:0.0:1788330225.284653:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+65:12480:x1875199766139520:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330225.284691:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330225.284721:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1e02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106159 expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.284811:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327a00/0x8475908e9fd1e09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.284829:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327a00/0x8475908e9fd1e09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.284866:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327a00/0x8475908e9fd1e09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330225.284927:0:12916:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788330225.284931:0:12916:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788330225.284957:0:12916:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327a00/0x8475908e9fd1e09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.284987:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1e02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106159 expref: 67 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.285009:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327a00/0x8475908e9fd1e09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106159 expref: 66 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.285019:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:0.0:1788330225.285022:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788330225.285027:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327a00, rc 0) 00000100:00100000:0.0:1788330225.285131:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+66:12480:x1875199766139520:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 480us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330225.285139:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 227 00000100:00100000:0.0:1788330225.297077:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330225.297356:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766139648 00000100:00100000:1.0:1788330225.297374:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766139648 00000100:00100000:1.0:1788330225.297456:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 228 00000100:00100000:1.0:1788330225.297470:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc847bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+66:12480:x1875199766139648:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1788330225.297513:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330225.297543:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064e00/0x8475908e9fd1e10 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106160 expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.297662:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd1e17 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.297683:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd1e17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.297697:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd1e17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.297709:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065c00/0x8475908e9fd1e1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.297716:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065c00/0x8475908e9fd1e1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.297722:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065c00/0x8475908e9fd1e1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.297834:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064c00/0x8475908e9fd1e25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.297845:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064c00/0x8475908e9fd1e25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.297852:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064c00/0x8475908e9fd1e25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330225.297910:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788330225.297916:0:7832:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788330225.297941:0:7832:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064c00/0x8475908e9fd1e25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.297967:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064c00/0x8475908e9fd1e25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.297978:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd1e17 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.297985:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd1e17 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.297993:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd1e17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.297999:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02065000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330225.298004:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd1e17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.298012:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd1e17 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.298027:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:1.0:1788330225.298030:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330225.298034:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd1e17 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.298040:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065000/0x8475908e9fd1e17 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.298066:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065c00/0x8475908e9fd1e1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.298073:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065c00/0x8475908e9fd1e1e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.298095:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065c00/0x8475908e9fd1e1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.298101:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02065c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330225.298104:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065c00/0x8475908e9fd1e1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.298111:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065c00/0x8475908e9fd1e1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.298118:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99eec91de600) 00010000:00010000:1.0:1788330225.298120:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330225.298123:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065c00/0x8475908e9fd1e1e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.298129:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02065c00/0x8475908e9fd1e1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.298618:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064e00/0x8475908e9fd1e10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106160 expref: 68 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.298641:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064c00/0x8475908e9fd1e25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106160 expref: 67 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.298650:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:1.0:1788330225.298653:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788330225.298656:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99ef02064c00, rc 0) 00000100:00100000:1.0:1788330225.298739:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc847bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+67:12480:x1875199766139648:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1272us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330225.298757:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 228 00000100:00100000:2.0:1788330225.305729:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330225.305798:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330225.305938:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766139904 00000100:00100000:1.0:1788330225.305952:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766139904 00000100:00100000:1.0:1788330225.306034:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 229 00000100:00100000:1.0:1788330225.306058:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+67:12480:x1875199766139904:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1788330225.306099:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330225.306432:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef400/0x8475908e9fd1e2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106167 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.306584:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef200/0x8475908e9fd1e33 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.306605:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1dfb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106152 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.306615:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064c00/0x8475908e9fd1e25 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106160 expref: 68 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.306623:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef200/0x8475908e9fd1e33 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.306665:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064c00/0x8475908e9fd1e25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106160 expref: 68 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.306682:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064c00/0x8475908e9fd1e25 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106160 expref: 68 pid: 7832 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330225.306698:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8589f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792408832:192.168.202.50@tcp:104: 00010000:00010000:1.0:1788330225.306912:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1dfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106152 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.306922:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1dfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106152 expref: 68 pid: 6522 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330225.306934:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc858b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792408960:192.168.202.50@tcp:104: 00000100:00100000:1.0:1788330225.306962:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3704e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788330225.307230:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766140032 00000100:00100000:3.0:1788330225.307238:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766140032 00010000:00010000:3.0:1788330225.307273:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064c00/0x8475908e9fd1e25 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106160 expref: 69 pid: 7832 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330225.307311:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 101 00000100:00100000:3.0:1788330225.307321:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec986e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+69:2412:x1875199766140032:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330225.307333:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330225.307340:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064c00/0x8475908e9fd1e25 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106160 expref: 69 pid: 7832 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330225.307356:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064c00/0x8475908e9fd1e25 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106160 expref: 69 pid: 7832 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330225.307392:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:3.0:1788330225.307399:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef200/0x8475908e9fd1e33 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330225.307407:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef200/0x8475908e9fd1e33 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330225.307415:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330225.307450:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec986e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+69:2412:x1875199766140032:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 130us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330225.307459:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 101 00000100:00100000:0.0:1788330225.312852:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330225.312967:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766140160 00000100:00100000:2.0:1788330225.312982:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766140160 00010000:00010000:2.0:1788330225.313041:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1dfb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106152 expref: 69 pid: 6522 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330225.313112:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 102 00000100:00100000:2.0:1788330225.313125:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8479500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+69:2413:x1875199766140160:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330225.313147:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330225.313196:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1dfb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106152 expref: 69 pid: 6522 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.313224:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1dfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106152 expref: 69 pid: 6522 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.313256:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:2.0:1788330225.313261:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef200/0x8475908e9fd1e33 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.313273:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef200/0x8475908e9fd1e33 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.313282:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef200/0x8475908e9fd1e33 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.313324:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330225.313393:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8479500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+69:2413:x1875199766140160:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 269us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330225.313401:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 102 00010000:00010000:1.0:1788330225.315360:0:6522:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.50@tcp) returned -22 from blocking AST (req@00000000264dc2b4 x1875199792408832) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064c00/0x8475908e9fd1e25 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106160 expref: 68 pid: 7832 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.315394:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064c00/0x8475908e9fd1e25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106160 expref: 68 pid: 7832 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330225.315422:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8589f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792408832:192.168.202.50@tcp:104: 00010000:00010000:1.0:1788330225.315444:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039a00/0x8475908e9fd1dfb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106152 expref: 67 pid: 6522 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330225.315457:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc858b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1875199792408960:192.168.202.50@tcp:104: 00010000:00010000:1.0:1788330225.315655:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:1.0:1788330225.315667:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef200/0x8475908e9fd1e33 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.315678:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef200/0x8475908e9fd1e33 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.315707:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef200/0x8475908e9fd1e33 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330225.315736:0:6522:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788330225.316000:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef400/0x8475908e9fd1e2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106167 expref: 68 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.316021:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef200/0x8475908e9fd1e33 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106167 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.316031:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:1.0:1788330225.316034:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788330225.316037:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eefe7ef200, rc 0) 00000100:00100000:1.0:1788330225.316368:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+67:12480:x1875199766139904:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 10322us (10655us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788330225.316379:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 229 00000100:00100000:0.0:1788330225.321523:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330225.321651:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766140416 00000100:00100000:2.0:1788330225.321667:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766140416 00000100:00100000:2.0:1788330225.321756:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:2.0:1788330225.321771:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8478380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+67:12480:x1875199766140416:12345-192.168.202.50@tcp:103:lfs.0 00010000:00010000:2.0:1788330225.321791:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330225.321831:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd1d84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106136 expref: 67 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.321856:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:2.0:1788330225.321863:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330225.321957:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8478380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+66:12480:x1875199766140416:12345-192.168.202.50@tcp:103:lfs.0 Request processed in 187us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330225.321964:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:0.0:1788330225.324955:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330225.325368:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766140544 00000100:00100000:3.0:1788330225.325381:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766140544 00000100:00100000:3.0:1788330225.325455:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 230 00000100:00100000:3.0:1788330225.325468:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc847b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+66:12480:x1875199766140544:12345-192.168.202.50@tcp:58:lfs.0 00010000:00010000:3.0:1788330225.325640:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1e41 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330225.325668:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1e41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330225.325681:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1e41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788330225.325808:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788330225.325972:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc847b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+66:12480:x1875199766140544:12345-192.168.202.50@tcp:58:lfs.0 Request processed in 506us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330225.325980:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 230 00000100:00100000:0.0:1788330225.331718:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330225.331906:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766140672 00000100:00100000:1.0:1788330225.331921:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766140672 00000100:00100000:1.0:1788330225.332002:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 231 00000100:00100000:1.0:1788330225.332015:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+66:12480:x1875199766140672:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1788330225.332055:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330225.332097:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd1e48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610616e expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.332200:0:7832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1e41 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.332241:0:7832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd1e48 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610616e expref: 67 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.332265:0:7832:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1e41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.332282:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd1e48 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610616e expref: 67 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.332300:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:1.0:1788330225.332304:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330225.332308:0:7832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd1e48 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610616e expref: 67 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330225.332316:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eefe7ee400, rc 0) 00000100:00100000:1.0:1788330225.332545:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+67:12480:x1875199766140672:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 531us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330225.332554:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 231 00010000:00010000:3.0:1788330225.563494:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788330226.075543:0:13809:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788330226.075558:0:13809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788330226.075594:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788330226.075620:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788330226.075804:0:13809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc847b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13809:1875199792409088:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788330226.075965:0:13809:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330226.084698:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330226.084910:0:13809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc847b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13809:1875199792409088:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788330226.087482:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766140800 00000100:00100000:2.0:1788330226.087508:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766140800 00000100:00100000:2.0:1788330226.087693:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 232 00000100:00100000:2.0:1788330226.087707:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+67:12481:x1875199766140800:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788330226.087757:0:6522:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788330226.087949:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+67:12481:x1875199766140800:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 244us (3268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330226.087958:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 232 00000100:00100000:1.0:1788330226.099177:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330226.099387:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766140928 00000100:00100000:0.0:1788330226.099401:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766140928 00000100:00100000:0.0:1788330226.099488:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 233 00000100:00100000:0.0:1788330226.099501:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc858b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+67:12481:x1875199766140928:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788330226.099601:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1e4f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099624:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1e4f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099641:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1e4f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099660:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1e56 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099667:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1e56 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099675:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1e56 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099704:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1e5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099714:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1e5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099740:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1e5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330226.099799:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788330226.099805:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788330226.099821:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1e5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099835:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1e4f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099842:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1e4f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099849:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1e4f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099856:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330226.099862:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1e4f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099870:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1e4f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099886:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99eec9216d00) 00010000:00010000:0.0:1788330226.099890:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330226.099895:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1e4f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099901:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1e4f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099926:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1e56 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099932:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1e56 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099939:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1e56 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099944:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330226.099947:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1e56 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099954:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1e56 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099962:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff99eec91ded00) 00010000:00010000:0.0:1788330226.099965:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330226.099968:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1e56 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099973:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1e56 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.099994:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1e5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.100001:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1e5d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.100007:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1e5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.100023:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330226.100026:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1e5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.100033:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1e5d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.100054:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:0.0:1788330226.100057:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330226.100060:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1e5d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.100066:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327c00/0x8475908e9fd1e5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330226.100216:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc858b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+67:12481:x1875199766140928:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 Request processed in 706us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330226.100226:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 233 00000100:00100000:0.0:1788330226.105862:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330226.105971:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766141184 00000100:00100000:1.0:1788330226.105985:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766141184 00000100:00100000:1.0:1788330226.106101:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 234 00000100:00100000:1.0:1788330226.106115:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc847b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+67:12481:x1875199766141184:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330226.106146:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330226.106224:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee800/0x8475908e9fd1e64 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106175 expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.106543:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef600/0x8475908e9fd1e6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.106565:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef600/0x8475908e9fd1e6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.106580:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef600/0x8475908e9fd1e6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330226.106596:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788330226.106703:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef600/0x8475908e9fd1e6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.106713:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef600/0x8475908e9fd1e6b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.106721:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef600/0x8475908e9fd1e6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.106728:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330226.106733:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef600/0x8475908e9fd1e6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.106742:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef600/0x8475908e9fd1e6b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.106758:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:1.0:1788330226.106762:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788330226.106767:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef600/0x8475908e9fd1e6b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.106785:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef600/0x8475908e9fd1e6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.106837:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee800/0x8475908e9fd1e64 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106175 expref: 69 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.106850:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99eec9216d00) 00010000:00010000:1.0:1788330226.106853:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788330226.106857:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee800/0x8475908e9fd1e64 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106175 expref: 69 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.106868:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eefe7ee800, rc 0) 00000100:00100000:1.0:1788330226.106950:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc847b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+68:12481:x1875199766141184:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 836us (1105us total) trans 4294967506 rc 301/301 00000100:00100000:1.0:1788330226.106959:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 234 00000100:00100000:1.0:1788330226.112980:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330226.113195:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766141312 00000100:00100000:2.0:1788330226.113219:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766141312 00000100:00100000:2.0:1788330226.113300:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 235 00000100:00100000:2.0:1788330226.113311:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+68:12481:x1875199766141312:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788330226.114264:0:6522:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788330226.114711:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+68:12481:x1875199766141312:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 1395us (1739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330226.114725:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 235 00000100:00100000:0.0:1788330226.124594:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330226.125622:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766141568 00000100:00100000:3.0:1788330226.125643:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766141568 00000100:00100000:3.0:1788330226.125734:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 236 00000100:00100000:3.0:1788330226.125748:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc847a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+68:12481:x1875199766141568:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330226.125779:0:12916:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330226.125783:0:12916:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788330226.125822:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327a00/0x8475908e9fd1e09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106159 expref: 68 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.125847:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:3.0:1788330226.125854:0:12916:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330226.125873:0:12916:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1e79 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610617c expref: -99 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788330226.126861:0:12916:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:3.0:1788330226.127115:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1e80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.127135:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1e80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.127179:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1e80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.127707:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1e79 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610617c expref: 70 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.127730:0:12916:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1e80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610617c expref: 69 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.127755:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99edc7580c00) 00010000:00010000:3.0:1788330226.127759:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788330226.127762:0:12916:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59ca600, rc 0) 00000100:00100000:3.0:1788330226.127923:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc847a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+69:12481:x1875199766141568:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 2176us (3346us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788330226.127934:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 236 00000100:00100000:2.0:1788330226.137197:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330226.137565:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766141824 00000100:00100000:3.0:1788330226.137581:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766141824 00000100:00100000:3.0:1788330226.137711:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 237 00000100:00100000:3.0:1788330226.137725:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+69:12481:x1875199766141824:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788330226.137806:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330226.137843:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca600/0x8475908e9fd1e80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610617c expref: 69 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.137865:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99edc7580c00) 00010000:00010000:3.0:1788330226.137878:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330226.137905:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1e8e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.137922:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1e8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.137933:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1e8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.142016:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1e95 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xeb10ac60 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.142074:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1e95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xeb10ac60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.142090:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1e95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xeb10ac60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.142174:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1e8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.142181:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1e8e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.142188:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1e8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.142195:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330226.142199:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1e8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.142206:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1e8e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.142219:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:3.0:1788330226.142222:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330226.142227:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1e8e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.142233:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1e8e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.142250:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1e95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xeb10ac60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.142882:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1e95 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xeb10ac60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.142891:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1e95 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xeb10ac60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.142897:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330226.142900:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1e95 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xeb10ac60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.142907:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1e95 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xeb10ac60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.143103:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xeb10ac60 (ffff99edc7580e00) 00010000:00010000:3.0:1788330226.143107:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330226.143112:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1e95 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xeb10ac60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.143118:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1e95 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xeb10ac60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330226.144112:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+68:12481:x1875199766141824:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 6380us (6959us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788330226.144124:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 237 00000100:00100000:1.0:1788330226.150742:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330226.150849:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766141952 00000100:00100000:0.0:1788330226.150861:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766141952 00000100:00100000:0.0:1788330226.150936:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 238 00000100:00100000:0.0:1788330226.150948:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+68:12481:x1875199766141952:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330226.150971:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330226.151019:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1e9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106183 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.151070:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1ea3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.151085:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.151097:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.151258:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326400/0x8475908e9fd1e9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106183 expref: 70 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.151518:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106183 expref: 69 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.151527:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99eec91ded00) 00010000:00010000:0.0:1788330226.151530:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788330226.151534:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326800, rc 0) 00000100:00100000:0.0:1788330226.151601:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+69:12481:x1875199766141952:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 654us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330226.151608:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 238 00000100:00100000:0.0:1788330226.156628:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330226.156912:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766142208 00000100:00100000:3.0:1788330226.156926:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766142208 00000100:00100000:3.0:1788330226.156992:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 239 00000100:00100000:3.0:1788330226.157004:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc847aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+69:12481:x1875199766142208:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788330226.157108:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1eaa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.157147:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1eaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.157201:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1eaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788330226.157389:0:12916:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1788330226.157400:0:12916:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 430129248508ns, next at 431129246080ns, rc = 0 00000004:00010000:3.0:1788330226.157458:0:12916:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000028f15ed1 reply state 00000000b399bb52 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1eaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.157472:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1eaa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.157479:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99eec91ded00) 00010000:00010000:3.0:1788330226.157482:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788330226.157486:0:12916:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788330226.157594:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc847aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+71:12481:x1875199766142208:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 592us (976us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1788330226.157602:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 239 00000100:00100000:2.0:1788330226.162476:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330226.162585:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766142336 00000100:00100000:3.0:1788330226.162600:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766142336 00000100:00100000:3.0:1788330226.162681:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 240 00000100:00100000:3.0:1788330226.162695:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+71:12481:x1875199766142336:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330226.162732:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330226.162765:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1eb1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610618a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.162885:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1eb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610618a expref: 72 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.162904:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1eb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610618a expref: 72 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.162929:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99eec91ded00) 00010000:00010000:3.0:1788330226.162933:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788330226.162939:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef59cb800, rc 0) 00000100:00100000:3.0:1788330226.163019:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+72:12481:x1875199766142336:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 326us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330226.163029:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 240 00000100:00100000:1.0:1788330226.167566:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330226.167660:0:13409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766142464 00000100:00100000:3.0:1788330226.167678:0:13409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766142464 00000100:00080000:0.0:1788330226.167768:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330226.167801:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 71 00000100:00100000:3.0:1788330226.167817:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2412:x1875199766142464:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788330226.168945:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2412:x1875199766142464:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 1121us (1380us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788330226.168959:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 71 00000100:00100000:0.0:1788330226.178439:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330226.179389:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766142720 00000100:00100000:2.0:1788330226.179407:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766142720 00000100:00100000:2.0:1788330226.179493:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 60 00000100:00100000:2.0:1788330226.179508:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc847ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+72:12481:x1875199766142720:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788330226.179816:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc847ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+73:12481:x1875199766142720:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 310us (1395us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788330226.179825:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 60 00000100:00100000:0.0:1788330226.189000:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330226.189809:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766142976 00000100:00100000:1.0:1788330226.189827:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766142976 00000100:00100000:1.0:1788330226.189938:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 241 00000100:00100000:1.0:1788330226.189951:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+73:12481:x1875199766142976:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788330226.190145:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+73:12481:x1875199766142976:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 196us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330226.190320:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 241 00000100:00100000:1.0:1788330226.193881:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330226.194058:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766143104 00000100:00100000:0.0:1788330226.194073:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766143104 00000100:00100000:0.0:1788330226.194183:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 242 00000100:00100000:0.0:1788330226.194194:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+73:12481:x1875199766143104:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330226.194416:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330226.194447:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd1eb8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106191 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.194545:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1ebf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.194563:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1ebf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.194578:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1ebf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330226.194638:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788330226.194663:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1ebf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.194696:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326a00/0x8475908e9fd1eb8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106191 expref: 75 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.194717:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1ebf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106191 expref: 74 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.194727:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99eec91ded00) 00010000:00010000:0.0:1788330226.194730:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788330226.194734:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326c00, rc 0) 00000100:00100000:0.0:1788330226.194826:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+74:12481:x1875199766143104:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 634us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330226.194845:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 242 00000100:00100000:0.0:1788330226.205235:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330226.205421:0:13829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766143232 00000100:00100000:2.0:1788330226.205434:0:13829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766143232 00000100:00100000:2.0:1788330226.205515:0:13829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 72 00000100:00100000:2.0:1788330226.205528:0:13829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2410:x1875199766143232:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330226.205555:0:13829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330226.205583:0:13829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1ec6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106198 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788330226.205620:0:13829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a97c0f2, blocks: 0x0 00010000:00010000:2.0:1788330226.205665:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=430s v=(0 0) 00010000:00010000:2.0:1788330226.205670:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330226.205682:0:13829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1ec6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106198 expref: 9 pid: 13829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.205705:0:13829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1ec6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106198 expref: 9 pid: 13829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.205722:0:13829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039e00, rc 0) 00000100:00100000:2.0:1788330226.205804:0:13829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8478a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:2410:x1875199766143232:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 278us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330226.205813:0:13829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 72 00000100:00100000:2.0:1788330226.226028:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330226.226359:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766143488 00000100:00100000:3.0:1788330226.226375:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766143488 00000100:00100000:2.0:1788330226.226532:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 243 00000100:00100000:2.0:1788330226.226546:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+74:12481:x1875199766143488:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788330226.226723:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+74:12481:x1875199766143488:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 179us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330226.226732:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 243 00000100:00100000:3.0:1788330226.232398:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330226.232599:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766143616 00000100:00100000:0.0:1788330226.232613:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766143616 00000100:00100000:0.0:1788330226.232696:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 73 00000100:00100000:0.0:1788330226.232710:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:12481:x1875199766143616:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330226.232736:0:8632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330226.232762:0:8632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f8949cf/0x8475908e9fd1ecd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610619f expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.232805:0:8632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1ec6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106198 expref: 10 pid: 13829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.232816:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330226.232822:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330226.232828:0:8632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f8949cf/0x8475908e9fd1ecd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610619f expref: 10 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.232872:0:8632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1ec6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106198 expref: 10 pid: 13829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.232891:0:8632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1ec6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106198 expref: 10 pid: 13829 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330226.232912:0:8632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc847b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8632:1875199792409216:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330226.233072:0:8632:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665c780 going to sleep for 11 seconds 00000100:00100000:0.0:1788330226.236664:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330226.236773:0:13195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766143744 00000100:00100000:2.0:1788330226.236787:0:13195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766143744 00010000:00010000:2.0:1788330226.236849:0:13195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1ec6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106198 expref: 11 pid: 13829 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330226.236909:0:13195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 103 00000100:00100000:2.0:1788330226.236921:0:13195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8479c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+11:2412:x1875199766143744:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330226.236958:0:13195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330226.236988:0:13195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1ec6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106198 expref: 11 pid: 13829 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.237005:0:13195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1ec6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106198 expref: 11 pid: 13829 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.237048:0:13195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330226.237054:0:13195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330226.237065:0:13195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f8949cf/0x8475908e9fd1ecd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610619f expref: 11 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.237086:0:13195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f8949cf/0x8475908e9fd1ecd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610619f expref: 11 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.237139:0:13195:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000f8949cf/0x8475908e9fd1ecd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610619f expref: 11 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330226.237366:0:13195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7d69880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:13195:1875199792409344:192.168.202.50@tcp:105: 00000100:00100000:2.0:1788330226.237580:0:13195:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeccff7840 going to sleep for 11 seconds 00010000:00010000:1.0:1788330226.237695:0:8632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b55fd445/0x8475908e9fd1ec6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106198 expref: 11 pid: 13829 timeout: 530 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330226.237716:0:8632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc847b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8632:1875199792409216:192.168.202.50@tcp:104: 00010000:00010000:1.0:1788330226.237749:0:8632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000f8949cf/0x8475908e9fd1ecd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610619f expref: 10 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.237761:0:8632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327000, rc 0) 00000100:00100000:1.0:1788330226.237801:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+10:12481:x1875199766143616:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 5093us (5421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330226.237810:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 73 00000100:00100000:2.0:1788330226.243577:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330226.244001:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766143872 00000100:00100000:1.0:1788330226.244015:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766143872 00002000:00100000:1.0:1788330226.244112:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff99edc7d6a680 x1875199766143872/t0(0) o4->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:242/0 lens 504/0 e 0 to 0 dl 1788330237 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788330226.244126:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99edc7d6a680 with x1875199766143872 ext(0->12) 00002000:00010000:1.0:1788330226.244134:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99edc7d6a680 00000100:00100000:1.0:1788330226.244198:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:1.0:1788330226.244325:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+10:2413:x1875199766143872:12345-192.168.202.50@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788330226.245463:0:13195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7d69880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:13195:1875199792409344:192.168.202.50@tcp:105: 00010000:00010000:3.0:1788330226.245501:0:13195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330226.245843:0:13195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8479c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+12:2412:x1875199766143744:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 8923us (9193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330226.245855:0:13195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 103 00000100:00100000:1.0:1788330226.245937:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+11:2413:x1875199766143872:12345-192.168.202.50@tcp:4:lhsmtool_posix.0 Request processed in 1616us (2375us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788330226.245945:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00002000:00100000:1.0:1788330226.245956:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff99edc7d6a680 x1875199766143872/t4294967322(0) o4->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:242/0 lens 504/448 e 0 to 0 dl 1788330237 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788330226.245986:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99edc7d6a680 with x1875199766143872 ext(0->12) 00002000:00010000:1.0:1788330226.245991:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99edc7d6a680 00000100:00100000:1.0:1788330226.248892:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330226.248995:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766144000 00000100:00100000:3.0:1788330226.249025:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766144000 00000100:00100000:3.0:1788330226.249244:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 244 00000100:00100000:3.0:1788330226.249260:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc858a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+74:12481:x1875199766144000:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788330226.251102:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:1.0:1788330226.251122:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:1.0:1788330226.251196:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788330226.251226:0:6501:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99eec3704c00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788330226.251232:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99eef59da500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99eec3704900 00000020:00080000:1.0:1788330226.251235:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99eef59da800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99edc7e91a00 00000004:00080000:1.0:1788330226.251262:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788330226.251289:0:6501:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99eef6dd8840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788330226.251292:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99eec50b8f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99eef6dd86c0 00000020:00080000:1.0:1788330226.251295:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99eed0075800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99edc761e200 00000020:00080000:1.0:1788330226.251319:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788330226.251394:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:2.0:1788330226.251657:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1bd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251672:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1bd2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251696:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1bd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251702:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59ca000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330226.251708:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1bd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251717:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1bd2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251737:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff99eecbb95500) 00010000:00010000:2.0:1788330226.251741:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330226.251746:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1bd2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251753:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca000/0x8475908e9fd1bd2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251789:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251795:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c7a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251801:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251806:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330226.251808:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251824:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c7a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251831:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff99edc7580600) 00010000:00010000:2.0:1788330226.251834:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330226.251837:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c7a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251842:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb400/0x8475908e9fd1c7a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251859:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cf8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251866:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cf8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251873:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cf8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251878:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330226.251881:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cf8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251888:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cf8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251896:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99eec91de600) 00010000:00010000:2.0:1788330226.251899:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330226.251902:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cf8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251918:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326e00/0x8475908e9fd1cf8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251934:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1d1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251940:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1d1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251947:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1d1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251952:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78a00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330226.251954:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1d1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251961:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1d1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251969:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99eec91de600) 00010000:00010000:2.0:1788330226.251972:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330226.251974:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1d1b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251979:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd1d1b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.251997:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064000/0x8475908e9fd1ded lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.252003:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064000/0x8475908e9fd1ded lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.252016:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064000/0x8475908e9fd1ded lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.252021:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02064000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330226.252023:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064000/0x8475908e9fd1ded lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.252029:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064000/0x8475908e9fd1ded lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.252048:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:2.0:1788330226.252051:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330226.252054:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064000/0x8475908e9fd1ded lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.252059:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99ef02064000/0x8475908e9fd1ded lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.252085:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1eaa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.252092:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1eaa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.252098:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1eaa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.252103:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330226.252106:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1eaa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.252121:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1eaa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.252130:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99eec91ded00) 00010000:00010000:2.0:1788330226.252132:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788330226.252135:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1eaa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.252141:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb600/0x8475908e9fd1eaa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330226.252614:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792409728:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788330226.252711:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330226.252776:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792409600:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788330226.252804:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330226.252827:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330226.252833:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792409472:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788330226.252853:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330226.252886:0:13829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792409728 00000100:00100000:3.0:1788330226.252895:0:13829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792409728 00000100:00100000:3.0:1788330226.252968:0:13829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792409600 00000100:00100000:3.0:1788330226.252971:0:13829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792409600 00000100:00100000:3.0:1788330226.252990:0:13829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792409472 00000100:00100000:3.0:1788330226.252993:0:13829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792409472 00000100:00100000:3.0:1788330226.253017:0:13829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788330226.253029:0:13829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792409728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788330226.253137:0:13829:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:3.0:1788330226.253335:0:13829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a97c0f0, atime: 0x6a97c0f0, ctime: 0x6a97c0f0, blocks: 0x8 00010000:00010000:3.0:1788330226.253345:0:13829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd1ed4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.253368:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788330226.253373:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330226.253381:0:13829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd1ed4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.253417:0:13829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd1ed4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.253427:0:13829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd1ed4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.253435:0:13829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd1ed4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.253458:0:13829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788330226.253659:0:13829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3646:x1875199792409728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 630us (946us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788330226.253668:0:13829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788330226.253692:0:13829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788330226.253699:0:13829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3649:x1875199792409600:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788330226.253794:0:13829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788330226.253798:0:13829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788330226 00002000:00010000:3.0:1788330226.253801:0:13829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788330226.253803:0:13829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788330226 -> 1788330226 00002000:00010000:3.0:1788330226.253805:0:13829:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788330226.253836:0:13829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3649:x1875199792409600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 137us (1031us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788330226.253842:0:13829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788330226.253857:0:13829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788330226.253863:0:13829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3649:x1875199792409472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788330226.253882:0:13829:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:3.0:1788330226.253897:0:13829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dc7802b/0x8475908e9fd1edb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.253916:0:13829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1c88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060f7 expref: 10 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.253925:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788330226.253928:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788330226.253932:0:13829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dc7802b/0x8475908e9fd1edb lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.253969:0:13829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1c88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060f7 expref: 10 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.253987:0:13829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1c88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060f7 expref: 10 pid: 13829 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330226.254001:0:13829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13829:1875199792409856:192.168.202.50@tcp:104: 00000100:00080000:1.0:1788330226.254501:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330226.254621:0:13829:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59dbf00 going to sleep for 11 seconds 00010000:00010000:3.0:1788330226.254650:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330226.254659:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd1ed4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.254670:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59ca600 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330226.254675:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd1ed4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.254696:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd1ed4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.254718:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd1ed4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.254725:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e59dc0e/0x8475908e9fd1ed4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.254747:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330226.254749:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330226.254751:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788330226.254797:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99edc8456680/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788330226.254806:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792409728:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788330226.254838:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99edc8454700/2, rc 0, transno 4294967323 00000100:00100000:3.0:1788330226.254842:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8454700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792409600:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788330226.254977:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc858a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:12481:x1875199766144000:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 Request processed in 5720us (6099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330226.254988:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 244 00000100:00100000:0.0:1788330226.260577:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330226.260624:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330226.261012:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766144128 00000100:00100000:1.0:1788330226.261024:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766144128 00010000:00010000:1.0:1788330226.261101:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1c88 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060f7 expref: 11 pid: 13829 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330226.261175:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 104 00000100:00100000:1.0:1788330226.261186:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8478700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+11:2412:x1875199766144128:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330226.261217:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330226.261238:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1c88 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060f7 expref: 11 pid: 13829 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.261255:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1c88 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060f7 expref: 11 pid: 13829 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.261287:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330226.261292:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330226.261299:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003dc7802b/0x8475908e9fd1edb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.261311:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dc7802b/0x8475908e9fd1edb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.261337:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330226.261407:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8478700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+11:2412:x1875199766144128:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 222us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330226.261415:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 104 00010000:00010000:3.0:1788330226.262252:0:13829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d365a152/0x8475908e9fd1c88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060f7 expref: 10 pid: 13829 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330226.262276:0:13829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13829:1875199792409856:192.168.202.50@tcp:104: 00010000:00010000:3.0:1788330226.262308:0:13829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003dc7802b/0x8475908e9fd1edb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.262332:0:13829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003dc7802b/0x8475908e9fd1edb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.262340:0:13829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dc7802b/0x8475908e9fd1edb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.262351:0:13829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dc7802b/0x8475908e9fd1edb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.262360:0:13829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dc7802b/0x8475908e9fd1edb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.262388:0:13829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788330226.262890:0:13829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3649:x1875199792409472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9023us (10032us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788330226.262900:0:13829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788330226.262929:0:13829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766144256 00000100:00100000:3.0:1788330226.262936:0:13829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766144256 00000100:00100000:2.0:1788330226.263021:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 77 00000100:00100000:2.0:1788330226.263046:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+10:2413:x1875199766144256:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1788330226.263347:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330226.263357:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dc7802b/0x8475908e9fd1edb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.263369:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147b800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330226.263375:0:10341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dc7802b/0x8475908e9fd1edb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.263385:0:10341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dc7802b/0x8475908e9fd1edb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.263408:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dc7802b/0x8475908e9fd1edb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.263414:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dc7802b/0x8475908e9fd1edb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.263440:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330226.263441:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330226.263443:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788330226.263648:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99edc8454e00/2, rc 0, transno 4294967324 00000100:00100000:2.0:1788330226.263657:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792409472:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1788330226.267409:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1788330226.267434:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:0.0:1788330226.267648:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2413:x1875199766144256:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 Request processed in 4608us (7013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330226.267662:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 77 00000100:00100000:1.0:1788330226.271109:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330226.271243:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766144512 00000100:00100000:2.0:1788330226.271257:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766144512 00000100:00100000:2.0:1788330226.271336:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 245 00000100:00100000:2.0:1788330226.271349:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:12481:x1875199766144512:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788330226.271425:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330226.271464:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1ebf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106191 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.271499:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99eec91ded00) 00010000:00010000:2.0:1788330226.271522:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330226.271570:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1ee2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.271587:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.271600:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330226.271761:0:6522:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000016d9f23d reply state 00000000a4586763 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.271776:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1ee2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.271782:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99eec91ded00) 00010000:00010000:2.0:1788330226.271785:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788330226.271788:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330226.271925:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:12481:x1875199766144512:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 576us (829us total) trans 4294967510 rc 0/0 00000100:00100000:2.0:1788330226.271934:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 245 00000100:00100000:2.0:1788330226.275677:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330226.275770:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766144640 00000100:00100000:3.0:1788330226.275784:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766144640 00000100:00100000:3.0:1788330226.275859:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 78 00000100:00100000:3.0:1788330226.275871:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2412:x1875199766144640:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788330226.276102:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788330226.276106:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788330226 -> 1788330225 00002000:00010000:3.0:1788330226.276109:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788330224 00002000:00010000:3.0:1788330226.276125:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788330226 -> 1788330225 00002000:00010000:3.0:1788330226.276128:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788330226.276371:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2412:x1875199766144640:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 500us (705us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788330226.276380:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 78 00000100:00100000:1.0:1788330226.279506:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330226.279837:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766144896 00000100:00100000:2.0:1788330226.279851:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766144896 00000100:00100000:2.0:1788330226.279930:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 246 00000100:00100000:2.0:1788330226.279943:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc858a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:12481:x1875199766144896:12345-192.168.202.50@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788330226.280408:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1ee9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.280434:0:7832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1ea3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106183 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.280462:0:7832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1ee9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.280512:0:7832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106183 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.280529:0:7832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1ea3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106183 expref: 22 pid: 6522 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330226.280548:0:7832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7d6a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7832:1875199792409984:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330226.280733:0:7832:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeccff7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788330226.285804:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330226.285951:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766145024 00000100:00100000:3.0:1788330226.285965:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766145024 00010000:00010000:3.0:1788330226.286027:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1ea3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106183 expref: 23 pid: 6522 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330226.286109:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 105 00000100:00100000:3.0:1788330226.286122:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc858b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+23:2413:x1875199766145024:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330226.286143:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330226.286193:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1ea3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106183 expref: 23 pid: 6522 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.286224:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1ea3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106183 expref: 23 pid: 6522 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.286255:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99eec91ded00) 00010000:00010000:3.0:1788330226.286262:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1ee9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.286275:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1ee9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.286284:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1ee9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.286328:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330226.286400:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc858b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+23:2413:x1875199766145024:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 281us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330226.286409:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 105 00010000:00010000:2.0:1788330226.298121:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326800/0x8475908e9fd1ea3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106183 expref: 22 pid: 6522 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330226.298172:0:7832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7d6a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7832:1875199792409984:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330226.298218:0:7832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1ee9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.298230:0:7832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1ee9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.298236:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1ee9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.298290:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1ee9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.298298:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1ee9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.298326:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1ee9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.298333:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330226.298339:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1ee9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.298348:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1ee9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.298370:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99eec91ded00) 00010000:00010000:2.0:1788330226.298373:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788330226.298379:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1ee9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.298386:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1ee9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330226.298488:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc858a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:12481:x1875199766144896:12345-192.168.202.50@tcp:55:lhsmtool_posix.0 Request processed in 18547us (18996us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788330226.298500:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 246 00000100:00100000:1.0:1788330226.308567:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330226.309738:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766145152 00000100:00100000:3.0:1788330226.309757:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766145152 00000100:00100000:3.0:1788330226.309860:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 79 00000100:00100000:3.0:1788330226.309876:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2413:x1875199766145152:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788330226.309980:0:8632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000031eaaaa3/0x8475908e9fd1ef0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.310012:0:8632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000f8949cf/0x8475908e9fd1ecd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610619f expref: 8 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.310026:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330226.310032:0:8632:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788330226.310049:0:8632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031eaaaa3/0x8475908e9fd1ef0 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.310111:0:8632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000f8949cf/0x8475908e9fd1ecd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610619f expref: 8 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.310128:0:8632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000f8949cf/0x8475908e9fd1ecd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610619f expref: 8 pid: 8632 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330226.310147:0:8632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8632:1875199792410112:192.168.202.50@tcp:104: 00000100:00100000:3.0:1788330226.310409:0:8632:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59db600 going to sleep for 11 seconds 00000100:00100000:1.0:1788330226.315341:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330226.316454:0:13195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766145280 00000100:00100000:2.0:1788330226.316472:0:13195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766145280 00010000:00010000:2.0:1788330226.316531:0:13195:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000f8949cf/0x8475908e9fd1ecd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610619f expref: 9 pid: 8632 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330226.316583:0:13195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 106 00000100:00100000:2.0:1788330226.316597:0:13195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:2412:x1875199766145280:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330226.316637:0:13195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330226.316666:0:13195:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000f8949cf/0x8475908e9fd1ecd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610619f expref: 9 pid: 8632 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.316683:0:13195:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000f8949cf/0x8475908e9fd1ecd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610619f expref: 9 pid: 8632 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.316715:0:13195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788330226.316720:0:13195:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788330226.316727:0:13195:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000031eaaaa3/0x8475908e9fd1ef0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.316739:0:13195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031eaaaa3/0x8475908e9fd1ef0 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.316768:0:13195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330226.316840:0:13195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+9:2412:x1875199766145280:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 245us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330226.316860:0:13195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 106 00010000:00010000:3.0:1788330226.317090:0:8632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f8949cf/0x8475908e9fd1ecd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610619f expref: 8 pid: 8632 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330226.317109:0:8632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8632:1875199792410112:192.168.202.50@tcp:104: 00010000:00010000:3.0:1788330226.317137:0:8632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000031eaaaa3/0x8475908e9fd1ef0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.317177:0:8632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000031eaaaa3/0x8475908e9fd1ef0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.317186:0:8632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031eaaaa3/0x8475908e9fd1ef0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.317223:0:8632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000031eaaaa3/0x8475908e9fd1ef0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.317232:0:8632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031eaaaa3/0x8475908e9fd1ef0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.317240:0:8632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031eaaaa3/0x8475908e9fd1ef0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.317248:0:8632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147b200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330226.317253:0:8632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031eaaaa3/0x8475908e9fd1ef0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.317276:0:8632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031eaaaa3/0x8475908e9fd1ef0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.317290:0:8632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031eaaaa3/0x8475908e9fd1ef0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.317297:0:8632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031eaaaa3/0x8475908e9fd1ef0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330226.317353:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2413:x1875199766145152:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 Request processed in 7482us (8803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330226.317362:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 79 00000100:00100000:3.0:1788330226.320807:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330226.321318:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766145536 00000100:00100000:0.0:1788330226.321333:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766145536 00000100:00100000:0.0:1788330226.321409:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 247 00000100:00100000:0.0:1788330226.321426:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:12481:x1875199766145536:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788330226.321553:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1ef7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.321576:0:12916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1de6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610614b expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.321588:0:12916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1ef7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.321637:0:12916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1de6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610614b expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.321652:0:12916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1de6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610614b expref: 21 pid: 6524 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330226.321669:0:12916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8479f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792410240:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330226.322335:0:12916:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330226.331645:0:12916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8479f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792410240:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330226.331695:0:12916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1ef7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330226.332147:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330226.332243:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766145664 00000100:00100000:0.0:1788330226.332253:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766145664 00010000:00010000:0.0:1788330226.332308:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1de6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610614b expref: 22 pid: 6524 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330226.332414:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 107 00000100:00100000:0.0:1788330226.332427:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec986f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:2412:x1875199766145664:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330226.332447:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330226.332456:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1de6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610614b expref: 22 pid: 6524 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.332469:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1de6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610614b expref: 22 pid: 6524 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.332500:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59caa00/0x8475908e9fd1de6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610614b expref: 22 pid: 6524 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.332518:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:0.0:1788330226.332524:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd1e48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610616e expref: 21 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.332536:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1ef7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.332543:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.332550:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1ef7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.332584:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330226.332653:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec986f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:2412:x1875199766145664:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 229us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330226.332671:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 107 00010000:00010000:1.0:1788330226.332733:0:12916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.332742:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.334713:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee000/0x8475908e9fd1efe lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.334743:0:12916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1eb1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610618a expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.334750:0:12916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee000/0x8475908e9fd1efe lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.334789:0:12916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1eb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610618a expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.334802:0:12916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1eb1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610618a expref: 21 pid: 6524 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330226.334817:0:12916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792410368:192.168.202.50@tcp:104: 00000100:00100000:1.0:1788330226.334928:0:12916:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3704e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788330226.339340:0:12916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792410368:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330226.339385:0:12916:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee000/0x8475908e9fd1efe lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330226.340803:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330226.340951:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766145792 00000100:00100000:0.0:1788330226.340965:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766145792 00010000:00010000:0.0:1788330226.341020:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1eb1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610618a expref: 22 pid: 6524 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330226.341119:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 108 00000100:00100000:0.0:1788330226.341133:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:2413:x1875199766145792:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330226.341449:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330226.341459:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1eb1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610618a expref: 22 pid: 6524 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.341476:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1eb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610618a expref: 22 pid: 6524 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.342110:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb800/0x8475908e9fd1eb1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610618a expref: 22 pid: 6524 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.342135:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99eec91ded00) 00010000:00010000:0.0:1788330226.342141:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee000/0x8475908e9fd1efe lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.342205:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee000/0x8475908e9fd1efe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.342232:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee000/0x8475908e9fd1efe lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.342273:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330226.342368:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:2413:x1875199766145792:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 1236us (1577us total) trans 0 rc 0/0 00010000:00010000:1.0:1788330226.342375:0:12916:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee000/0x8475908e9fd1efe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330226.342377:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 108 00010000:00010000:1.0:1788330226.342384:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee000/0x8475908e9fd1efe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788330226.342543:0:12916:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1788330226.342657:0:12916:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:1.0:1788330226.342682:0:12916:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1788330226.342759:0:12916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12916:1875199792410496:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788330226.342827:0:12916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330226.342875:0:12916:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec4d88cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330226.343703:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792410496 00000100:00100000:0.0:1788330226.343716:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792410496 00000100:00100000:0.0:1788330226.343770:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788330226.343782:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12916:x1875199792410496:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788330226.344409:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12916:x1875199792410496:12345-0@lo:1000:mdt00_004.0 Request processed in 624us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330226.344420:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788330226.344438:0:12916:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1788330226.344444:0:12916:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99edc8454700, transno 4294967323 00000004:00080000:0.0:1788330226.344463:0:12916:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99edc8454e00, transno 4294967324 00000100:00100000:0.0:1788330226.344472:0:12916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12916:1875199792410496:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1788330226.344641:0:12916:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:0.0:1788330226.344714:0:12916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8479500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12916:1875199792410624:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788330226.344757:0:12916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330226.344791:0:12916:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330226.344828:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792410624 00000100:00100000:3.0:1788330226.344834:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792410624 00000100:00100000:3.0:1788330226.344870:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788330226.344879:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12916:x1875199792410624:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788330226.345002:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12916:x1875199792410624:12345-0@lo:1000:mdt00_004.0 Request processed in 124us (245us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788330226.345009:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788330226.345032:0:12916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8479500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12916:1875199792410624:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1788330226.345186:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee000/0x8475908e9fd1efe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.345265:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee000/0x8475908e9fd1efe lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.345276:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee000/0x8475908e9fd1efe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.345296:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330226.345302:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee000/0x8475908e9fd1efe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.345312:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee000/0x8475908e9fd1efe lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.345333:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99eec91ded00) 00010000:00010000:0.0:1788330226.345337:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788330226.345343:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee000/0x8475908e9fd1efe lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.345350:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee000/0x8475908e9fd1efe lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.345383:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1e41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.345390:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1e41 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.345396:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1e41 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.345401:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cb200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330226.345404:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1e41 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.345411:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1e41 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.345429:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:0.0:1788330226.345431:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788330226.345439:0:12916:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd1e48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610616e expref: 24 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.345453:0:12916:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd1e48 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610616e expref: 24 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.345462:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd1e48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610616e expref: 24 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.345491:0:12916:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd1e48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610616e expref: 24 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330226.345503:0:12916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8479c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792410752:192.168.202.50@tcp:105: 00000100:00100000:0.0:1788330226.345583:0:12916:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330226.349048:0:12916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8479c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12916:1875199792410752:192.168.202.50@tcp:105: 00010000:00010000:0.0:1788330226.349097:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1e41 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.349111:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59cb200/0x8475908e9fd1e41 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.349523:0:12916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1f05 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.349546:0:12916:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1f05 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330226.349566:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00010000:00010000:0.0:1788330226.349579:0:12916:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1f05 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.349593:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1f05 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.349600:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1f05 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.349608:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1f05 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.349615:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330226.349620:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1f05 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.349629:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1f05 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.349645:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:0.0:1788330226.349648:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330226.349652:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1f05 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.349658:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326200/0x8475908e9fd1f05 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330226.349659:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766145920 00000100:00100000:2.0:1788330226.349670:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766145920 00010000:00010000:0.0:1788330226.349671:0:12916:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.349676:0:12916:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1ef7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.349687:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.349692:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330226.349695:0:12916:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.349701:0:12916:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1ef7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.349708:0:12916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:0.0:1788330226.349711:0:12916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788330226.349713:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1ef7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330226.349719:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd1ef7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12916 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330226.349745:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:2.0:1788330226.349758:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+25:12480:x1875199766145920:12345-192.168.202.50@tcp:49:lfs.0 00000100:00100000:2.0:1788330226.349992:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+25:12480:x1875199766145920:12345-192.168.202.50@tcp:49:lfs.0 Request processed in 235us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330226.350010:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:0.0:1788330226.350232:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+24:12481:x1875199766145536:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 28808us (29440us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788330226.350244:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 247 00000020:00080000:0.0:1788330226.350248:0:12916:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788330226.351964:0:13809:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788330226.351977:0:13809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788330226.352875:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788330226.352896:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788330226.353506:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330226.353637:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766146176 00000100:00100000:3.0:1788330226.353651:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766146176 00000100:00100000:3.0:1788330226.353723:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 248 00000100:00100000:3.0:1788330226.353736:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+24:12480:x1875199766146176:12345-192.168.202.50@tcp:58:lfs.0 00000040:00080000:3.0:1788330226.353993:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788330226.354192:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+24:12480:x1875199766146176:12345-192.168.202.50@tcp:58:lfs.0 Request processed in 458us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330226.354206:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 248 00000100:00100000:2.0:1788330226.354726:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330226.355543:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766146432 00000100:00100000:1.0:1788330226.355558:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766146432 00000100:00100000:1.0:1788330226.355652:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 62 00000100:00100000:1.0:1788330226.355665:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9242850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+24:12481:x1875199766146432:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788330226.355997:0:6526:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788330226.356051:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:1.0:1788330226.356107:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd1f0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.356127:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd1f0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.356141:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd1f0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.356170:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd1f0c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.356178:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd1f0c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.356184:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd1f0c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.356344:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788330226.356457:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9242850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+26:12481:x1875199766146432:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 794us (1731us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788330226.356468:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 62 00000020:00080000:1.0:1788330226.356473:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788330226.356574:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330226.356583:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd1f0c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.356590:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330226.356595:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd1f0c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.356603:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd1f0c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.356618:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99eec91ded00) 00010000:00010000:3.0:1788330226.356621:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788330226.356627:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd1f0c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.356634:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd1f0c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330226.356647:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330226.356650:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330226.356651:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330226.390502:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330226.392357:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766146560 00000100:00100000:2.0:1788330226.392378:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766146560 00000100:00100000:2.0:1788330226.392479:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 249 00000100:00100000:2.0:1788330226.392492:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+26:12483:x1875199766146560:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330226.392529:0:7832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330226.392558:0:7832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1f13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61061a6 expref: -99 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.392648:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1f1a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.392668:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1f1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.392681:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1f1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.392700:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1f21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.392707:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1f21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.392714:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1f21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.392810:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1f28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.392837:0:7832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef200/0x8475908e9fd1e33 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106167 expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.392847:0:7832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1f28 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.392895:0:7832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef200/0x8475908e9fd1e33 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106167 expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.392913:0:7832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef200/0x8475908e9fd1e33 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106167 expref: 27 pid: 6522 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330226.392930:0:7832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7d6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7832:1875199792410880:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330226.393075:0:7832:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeccff7900 going to sleep for 11 seconds 00000100:00100000:2.0:1788330226.397208:0:7832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7d6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7832:1875199792410880:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330226.397337:0:7832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1f28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330226.397951:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330226.398506:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766146816 00000100:00100000:2.0:1788330226.398519:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766146816 00000100:00100000:2.0:1788330226.398649:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:2.0:1788330226.398661:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+28:6184:x1875199766146816:12345-192.168.202.50@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788330226.398932:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+29:6184:x1875199766146816:12345-192.168.202.50@tcp:35:ldlm_bl.0 Request processed in 272us (984us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788330226.398940:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:0.0:1788330226.401971:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330226.402078:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766146944 00000100:00100000:2.0:1788330226.402106:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766146944 00010000:00010000:2.0:1788330226.402236:0:8454:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef200/0x8475908e9fd1e33 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106167 expref: 29 pid: 6522 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330226.402344:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 109 00000100:00100000:2.0:1788330226.402357:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8479c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+29:2413:x1875199766146944:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330226.402378:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330226.402387:0:8454:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef200/0x8475908e9fd1e33 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106167 expref: 29 pid: 6522 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.402401:0:8454:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef200/0x8475908e9fd1e33 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106167 expref: 29 pid: 6522 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.402430:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef200/0x8475908e9fd1e33 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106167 expref: 29 pid: 6522 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.402447:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:2.0:1788330226.402452:0:8454:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1f28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.402463:0:8454:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1f28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.402471:0:8454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1f28 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330226.402515:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330226.402591:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8479c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+28:2413:x1875199766146944:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 236us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330226.402612:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 109 00010000:00010000:1.0:1788330226.403219:0:7832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1f28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.403230:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1f28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330226.403292:0:7832:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788330226.403298:0:7832:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788330226.403333:0:7832:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1f28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.403349:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1f28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.403360:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1f1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.403368:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1f1a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.403376:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1f1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.403382:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330226.403386:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1f1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.403404:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1f1a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.403416:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:1.0:1788330226.403419:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330226.403423:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1f1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.403430:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd1f1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.403444:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1f21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.403450:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1f21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.403456:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1f21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.403461:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330226.403465:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1f21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.403470:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1f21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.403477:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff99eecbb95800) 00010000:00010000:1.0:1788330226.403479:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330226.403482:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1f21 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.403495:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039e00/0x8475908e9fd1f21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.403541:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038c00/0x8475908e9fd1f13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061a6 expref: 28 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.403557:0:7832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1f28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061a6 expref: 27 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330226.403566:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:1.0:1788330226.403569:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788330226.403571:0:7832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038600, rc 0) 00000100:00100000:1.0:1788330226.403630:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+27:12483:x1875199766146560:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 11141us (13157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330226.403638:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 249 00000100:00100000:1.0:1788330226.598788:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330226.598836:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792411008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330226.598952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330226.599070:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792411008 00000100:00100000:1.0:1788330226.599082:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792411008 00000100:00100000:1.0:1788330226.599203:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788330226.599215:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792411008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788330226.599266:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330226.599329:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792411008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330226.599338:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:1.0:1788330226.599382:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330226.599452:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792411008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788330226.601836:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792411136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330226.601959:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330226.602472:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792411136 00000100:00100000:1.0:1788330226.602498:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792411136 00000100:00100000:1.0:1788330226.602578:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788330226.602593:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875199792411136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330226.602628:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330226.602702:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875199792411136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330226.602709:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00010000:00010000:0.0:1788330226.603626:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330226.603845:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792411136:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788330227.358140:0:13809:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788330227.358190:0:13809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788330227.358223:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788330227.358231:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788330227.358441:0:13809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8478700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13809:1875199792411264:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788330227.358609:0:13809:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788330227.360998:0:13809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8478700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13809:1875199792411264:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788330227.371930:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330227.372020:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766147072 00000100:00100000:0.0:1788330227.372118:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766147072 00000100:00100000:0.0:1788330227.375316:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 250 00000100:00100000:0.0:1788330227.375341:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+27:12495:x1875199766147072:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788330227.375400:0:12916:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788330227.375581:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+27:12495:x1875199766147072:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 249us (3666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330227.375589:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 250 00000100:00080000:1.0:1788330227.375907:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330227.384456:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330227.384554:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766147328 00000100:00100000:2.0:1788330227.384570:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766147328 00000100:00100000:2.0:1788330227.384666:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 251 00000100:00100000:2.0:1788330227.384681:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+27:12495:x1875199766147328:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330227.384719:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330227.384755:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1f2f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61061ad expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330227.384924:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1f36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330227.384944:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1f36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330227.384962:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1f36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330227.384977:0:6524:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788330227.385145:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039c00/0x8475908e9fd1f2f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061ad expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330227.385198:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1f36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061ad expref: 29 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330227.385230:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:2.0:1788330227.385233:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330227.385238:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038400, rc 0) 00000100:00100000:2.0:1788330227.385319:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+29:12495:x1875199766147328:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 640us (880us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788330227.385328:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 251 00000100:00100000:0.0:1788330227.391397:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330227.392079:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766147712 00000100:00100000:1.0:1788330227.392096:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766147712 00000100:00100000:1.0:1788330227.392213:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:1.0:1788330227.392228:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc847a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+29:2411:x1875199766147712:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330227.392251:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330227.392287:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd1f36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061ad expref: 29 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330227.392309:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:1.0:1788330227.392315:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330227.392394:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc847a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+28:2411:x1875199766147712:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 169us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330227.392675:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330227.402237:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766147584 00000100:00100000:0.0:1788330227.402265:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766147584 00000100:00100000:0.0:1788330227.402358:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 252 00000100:00100000:0.0:1788330227.402372:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+29:12495:x1875199766147584:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788330227.402503:0:7832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1f44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330227.402528:0:7832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1f44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330227.402543:0:7832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1f44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330227.402787:0:7832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1f44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330227.402795:0:7832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1f44 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330227.402818:0:7832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1f44 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330227.402825:0:7832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330227.402831:0:7832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1f44 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330227.402842:0:7832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1f44 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330227.402858:0:7832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:0.0:1788330227.402862:0:7832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788330227.402868:0:7832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1f44 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330227.402876:0:7832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1f44 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330227.403072:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+30:12495:x1875199766147584:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 701us (10395us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788330227.403083:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 252 00000040:00080000:0.0:1788330227.403285:0:13809:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788330227.403292:0:13809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788330227.403805:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788330227.403818:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788330227.411766:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330227.412104:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:1.0:1788330227.412186:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766147968 00000100:00100000:1.0:1788330227.412199:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766147968 00000100:00100000:1.0:1788330227.412262:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 64 00000100:00100000:1.0:1788330227.412273:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+29:12495:x1875199766147968:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788330227.412605:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+30:12495:x1875199766147968:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 332us (852us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788330227.412613:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 64 00000040:00080000:2.0:1788330227.546913:0:14720:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788330227.546926:0:14720:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788330227.546959:0:14720:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788330227.546975:0:14720:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788330227.611431:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330227.613068:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330227.613102:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792411392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788330227.613246:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330227.614209:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792411392 00000100:00100000:0.0:1788330227.614225:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792411392 00000100:00100000:0.0:1788330227.614293:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788330227.614305:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee75f2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792411392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788330227.614364:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788330227.614463:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee75f2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792411392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 160us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330227.614470:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788330227.615366:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7d6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792411392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330227.815801:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330227.816263:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766148224 00000100:00100000:0.0:1788330227.816277:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766148224 00000100:00100000:0.0:1788330227.816364:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 253 00000100:00100000:0.0:1788330227.816378:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+30:12508:x1875199766148224:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330227.816416:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330227.816445:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1f4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61061b4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330227.816600:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1f52 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330227.816623:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1f52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330227.816638:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1f52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330227.816652:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788330227.816801:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327600/0x8475908e9fd1f4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061b4 expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330227.816824:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1f52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061b4 expref: 32 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330227.816851:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:0.0:1788330227.816854:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788330227.816860:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326c00, rc 0) 00000100:00100000:0.0:1788330227.816945:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+32:12508:x1875199766148224:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 569us (1160us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788330227.816953:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 253 00000100:00100000:1.0:1788330227.828221:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330227.828283:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766148352 00000100:00100000:1.0:1788330227.828296:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766148352 00000100:00100000:1.0:1788330227.828378:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 254 00000100:00100000:1.0:1788330227.828392:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+32:12508:x1875199766148352:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:1.0:1788330227.828486:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7efe00/0x8475908e9fd1f60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330227.828510:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7efe00/0x8475908e9fd1f60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330227.828524:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7efe00/0x8475908e9fd1f60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330227.828571:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7efe00/0x8475908e9fd1f60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330227.828578:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7efe00/0x8475908e9fd1f60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330227.828587:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7efe00/0x8475908e9fd1f60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330227.828606:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7efe00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330227.828611:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7efe00/0x8475908e9fd1f60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330227.828619:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7efe00/0x8475908e9fd1f60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330227.828634:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:1.0:1788330227.828637:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788330227.828643:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7efe00/0x8475908e9fd1f60 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330227.828650:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7efe00/0x8475908e9fd1f60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330227.828746:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+32:12508:x1875199766148352:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 357us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330227.828754:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 254 00000100:00100000:0.0:1788330227.971565:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330227.971702:0:13829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766148480 00000100:00100000:3.0:1788330227.971717:0:13829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766148480 00000100:00100000:3.0:1788330227.971805:0:13829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 80 00000100:00100000:3.0:1788330227.971819:0:13829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2413:x1875199766148480:12345-192.168.202.50@tcp:101:cat.0 00010000:00010000:3.0:1788330227.971849:0:13829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330227.971879:0:13829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd72b2f5/0x8475908e9fd1f67 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61061bb expref: -99 pid: 13829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788330227.971919:0:13829:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a97c0f1, atime: 0x6a97c0f0, ctime: 0x6a97c0f1, blocks: 0x8 00010000:00010000:3.0:1788330227.971950:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=431s v=(0 0) 00010000:00010000:3.0:1788330227.971956:0:13829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330227.971969:0:13829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd72b2f5/0x8475908e9fd1f67 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061bb expref: 8 pid: 13829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330227.971994:0:13829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd72b2f5/0x8475908e9fd1f67 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061bb expref: 8 pid: 13829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330227.972011:0:13829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147ba00, rc 0) 00000100:00100000:3.0:1788330227.972144:0:13829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8478700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2413:x1875199766148480:12345-192.168.202.50@tcp:101:cat.0 Request processed in 328us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330227.972196:0:13829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 80 00000100:00100000:1.0:1788330227.980027:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330227.980203:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766148608 00000100:00100000:2.0:1788330227.980219:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766148608 00002000:00100000:2.0:1788330227.980291:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff99eeffcf9f80 x1875199766148608/t0(0) o3->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:243/0 lens 488/0 e 0 to 0 dl 1788330238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788330227.980305:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99eeffcf9f80 with x1875199766148608 ext(0->4095) 00002000:00010000:2.0:1788330227.980312:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99eeffcf9f80 00000100:00100000:2.0:1788330227.980351:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:2.0:1788330227.980362:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2413:x1875199766148608:12345-192.168.202.50@tcp:3:cat.0 00000100:00100000:2.0:1788330227.980598:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2413:x1875199766148608:12345-192.168.202.50@tcp:3:cat.0 Request processed in 235us (594us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788330227.980621:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 8 00002000:00100000:2.0:1788330227.980631:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff99eeffcf9f80 x1875199766148608/t0(0) o3->f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3@192.168.202.50@tcp:243/0 lens 488/4536 e 0 to 0 dl 1788330238 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788330227.980640:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99eeffcf9f80 with x1875199766148608 ext(0->4095) 00002000:00010000:2.0:1788330227.980644:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99eeffcf9f80 00000100:00100000:3.0:1788330228.123879:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792411648:0@lo:400:kworker.0 00000100:00100000:1.0:1788330228.123944:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792411904:0@lo:400:kworker.0 00000100:00100000:3.0:1788330228.123980:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330228.124011:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792411648 00000100:00100000:1.0:1788330228.124034:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792411648 00000100:00100000:2.0:1788330228.124129:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792411520:0@lo:400:kworker.0 00000100:00100000:3.0:1788330228.124144:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792412160:0@lo:400:kworker.0 00000100:00100000:0.0:1788330228.124239:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792411776:0@lo:400:kworker.0 00000100:00100000:1.0:1788330228.126791:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788330228.126829:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792411648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330228.135398:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330228.135494:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792412672:0@lo:400:kworker.0 00000100:00100000:3.0:1788330228.135566:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330228.135637:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792412160 00000100:00100000:3.0:1788330228.135649:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792412160 00000100:00100000:3.0:1788330228.135724:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792412672 00000100:00100000:3.0:1788330228.135728:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792412672 00000100:00100000:3.0:1788330228.135751:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788330228.135764:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792412160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330228.135844:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792412160:12345-0@lo:400:kworker.0 Request processed in 82us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330228.135853:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788330228.135876:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788330228.135884:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792412672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330228.135913:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875199792412672:12345-0@lo:400:kworker.0 Request processed in 30us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330228.135920:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00080000:3.0:1788330228.135940:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330228.135958:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330228.135993:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792412416:0@lo:400:kworker.0 00000100:00100000:3.0:1788330228.136040:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330228.137055:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330228.142087:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330228.142194:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792412288:0@lo:400:kworker.0 00000100:00100000:0.0:1788330228.142273:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330228.142290:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792412800:0@lo:400:kworker.0 00000100:00100000:0.0:1788330228.142320:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330228.142379:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792411904 00000100:00100000:0.0:1788330228.142389:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792411904 00000100:00100000:0.0:1788330228.142441:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792412288 00000100:00100000:0.0:1788330228.142444:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792412288 00000100:00100000:0.0:1788330228.142476:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792412800 00000100:00100000:0.0:1788330228.142480:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792412800 00000100:00100000:0.0:1788330228.142497:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788330228.142506:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792411904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330228.142576:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792411904:12345-0@lo:400:kworker.0 Request processed in 70us (6617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330228.142583:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788330228.142608:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788330228.142631:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc847b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792412288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330228.142667:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc847b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792412288:12345-0@lo:400:kworker.0 Request processed in 38us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330228.142674:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788330228.142686:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1788330228.142692:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc858b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792412800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330228.142718:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc858b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792412800:12345-0@lo:400:kworker.0 Request processed in 27us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330228.142724:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00010000:00080000:0.0:1788330228.142772:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcf9880 x1875199792412288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330228.142791:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792412288:0@lo:400:kworker.0 00010000:00080000:0.0:1788330228.142803:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcf9c00 x1875199792412800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330228.142812:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792412800:0@lo:400:kworker.0 00000100:00100000:0.0:1788330228.142977:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792411776 00000100:00100000:0.0:1788330228.142983:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792411776 00000100:00100000:0.0:1788330228.143015:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788330228.143036:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc847ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792411776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330228.143078:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc847ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792411776:12345-0@lo:400:kworker.0 Request processed in 43us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330228.143085:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788330228.143115:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792411776:0@lo:400:kworker.0 00000100:00080000:0.0:1788330228.143184:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788330228.143232:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792412160:0@lo:400:kworker.0 00000100:00100000:0.0:1788330228.143247:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875199792412672:0@lo:400:kworker.0 00000100:00100000:0.0:1788330228.143291:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792411520 00000100:00100000:0.0:1788330228.143295:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792411520 00000100:00100000:0.0:1788330228.143327:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1788330228.143334:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3646:x1875199792411520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330228.143373:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3646:x1875199792411520:12345-0@lo:400:kworker.0 Request processed in 40us (6328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330228.143378:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1788330228.143409:0:13409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792412416 00000100:00100000:0.0:1788330228.143416:0:13409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792412416 00000100:00100000:0.0:1788330228.143455:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788330228.143464:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792412416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330228.143512:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792412416:12345-0@lo:400:kworker.0 Request processed in 48us (7471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330228.143522:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:0.0:1788330228.143550:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330228.143740:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792411520:0@lo:400:kworker.0 00000100:00100000:2.0:1788330228.143752:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792412032:0@lo:400:kworker.0 00000100:00100000:2.0:1788330228.143786:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330228.143805:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792412544:0@lo:400:kworker.0 00000100:00100000:2.0:1788330228.143829:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330228.143848:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792413056:0@lo:400:kworker.0 00000100:00100000:2.0:1788330228.143870:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330228.143928:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792412544 00000100:00100000:2.0:1788330228.143933:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792412544 00000100:00100000:2.0:1788330228.143965:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792413056 00000100:00100000:2.0:1788330228.143968:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792413056 00000100:00100000:2.0:1788330228.143988:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788330228.143995:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3646:x1875199792412544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330228.144045:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3646:x1875199792412544:12345-0@lo:400:kworker.0 Request processed in 51us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330228.144052:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788330228.144064:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788330228.144079:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792413056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330228.144110:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792413056:12345-0@lo:400:kworker.0 Request processed in 32us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330228.144117:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1788330228.144132:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330228.144135:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330228.144172:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792412544:0@lo:400:kworker.0 00000100:00100000:2.0:1788330228.144185:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792413056:0@lo:400:kworker.0 00000100:00100000:0.0:1788330228.146090:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792412032 00000100:00100000:0.0:1788330228.146113:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792412032 00000100:00100000:0.0:1788330228.146303:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788330228.146318:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792412032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330228.146447:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792412032:12345-0@lo:400:kworker.0 Request processed in 133us (2660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330228.146455:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788330228.147283:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792412032:0@lo:400:kworker.0 00000100:00100000:1.0:1788330228.149622:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792411648:12345-0@lo:400:kworker.0 Request processed in 22794us (25624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330228.149643:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788330228.149825:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792411648:0@lo:400:kworker.0 00000100:00100000:3.0:1788330228.151502:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792412416:0@lo:400:kworker.0 00000100:00100000:3.0:1788330228.151525:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792412928:0@lo:400:kworker.0 00000100:00100000:3.0:1788330228.151613:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330228.151679:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792411904:0@lo:400:kworker.0 00000100:00100000:0.0:1788330228.151870:0:13409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792412928 00000100:00100000:0.0:1788330228.151894:0:13409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792412928 00000100:00100000:0.0:1788330228.152028:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788330228.152040:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792412928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330228.152126:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792412928:12345-0@lo:400:kworker.0 Request processed in 88us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330228.152134:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788330228.152171:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792412928:0@lo:400:kworker.0 00000100:00080000:2.0:1788330228.152550:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1788330228.189912:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788330228.443437:0:13809:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788330228.443451:0:13809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788330228.443479:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788330228.443491:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788330228.456388:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330228.456445:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330228.456488:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330228.456520:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330228.456544:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330228.456564:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330228.456588:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330228.456623:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766148992 00000100:00100000:0.0:1788330228.456635:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766148992 00000100:00100000:0.0:1788330228.456707:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766149504 00000100:00100000:0.0:1788330228.456710:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766149504 00000100:00100000:0.0:1788330228.456728:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766148864 00000100:00100000:0.0:1788330228.456730:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766148864 00000100:00100000:0.0:1788330228.456742:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766149376 00000100:00100000:0.0:1788330228.456744:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766149376 00000100:00100000:0.0:1788330228.456762:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 366 00000100:00100000:0.0:1788330228.456774:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc858bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766148992:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330228.456776:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766149248 00000100:00100000:2.0:1788330228.456780:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766149248 00000100:00100000:2.0:1788330228.456815:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766149120 00000100:00100000:2.0:1788330228.456817:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766149120 00000100:00100000:2.0:1788330228.456841:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 160 00000100:00100000:2.0:1788330228.456847:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2410:x1875199766149248:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330228.456871:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc858bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766148992:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 99us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330228.456875:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+8:2410:x1875199766149248:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 29us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330228.456882:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 160 00000100:00100000:0.0:1788330228.456894:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 366 00000100:00100000:2.0:1788330228.456902:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 161 00000100:00100000:2.0:1788330228.456908:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766149120:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330228.456908:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 367 00000100:00100000:0.0:1788330228.456913:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766149504:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330228.456930:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2410:x1875199766149120:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 23us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330228.456931:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766149504:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 19us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330228.456937:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 161 00000100:00100000:0.0:1788330228.456937:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 367 00000100:00100000:0.0:1788330228.456948:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 368 00000100:00100000:0.0:1788330228.456953:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc858b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+32:2410:x1875199766148864:12345-192.168.202.50@tcp:400:kworker.0 00000100:00080000:2.0:1788330228.456963:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788330228.456968:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330228.456971:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788330228.456973:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788330228.456975:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc858b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+32:2410:x1875199766148864:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 22us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330228.456981:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 368 00000100:00100000:0.0:1788330228.456990:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 369 00000100:00100000:0.0:1788330228.456996:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766149376:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330228.457031:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766149376:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 35us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330228.457038:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 369 00000100:00100000:3.0:1788330228.457239:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766148736 00000100:00100000:3.0:1788330228.457244:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766148736 00000100:00100000:3.0:1788330228.457288:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 397 00000100:00100000:3.0:1788330228.457305:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2410:x1875199766148736:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330228.457353:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2410:x1875199766148736:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 50us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330228.457360:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 397 00010000:00010000:3.0:1788330228.636299:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330229.675242:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330230.172390:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330230.172421:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792413184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330230.172522:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330230.172619:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792413184 00000100:00100000:2.0:1788330230.172629:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792413184 00000100:00100000:2.0:1788330230.172697:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788330230.172709:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792413184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788330230.172746:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788330230.172793:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792413184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330230.172801:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1788330230.172823:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788330230.172865:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792413184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330230.173719:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792413312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330230.173766:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330230.173935:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792413440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330230.173970:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330230.174067:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792413440 00000100:00100000:2.0:1788330230.174074:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792413440 00000100:00100000:2.0:1788330230.174124:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788330230.174131:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875199792413440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788330230.174169:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788330230.174229:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875199792413440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330230.174236:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1788330230.174365:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330230.174582:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792413440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330230.174650:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792413312 00000100:00100000:0.0:1788330230.174655:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792413312 00000100:00100000:0.0:1788330230.174694:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788330230.174702:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792413312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330230.174732:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788330230.174777:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792413312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330230.174790:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788330230.175249:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792413312:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788330230.683353:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788330231.197131:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:2.0:1788330231.709180:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330231.709290:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788330231.709322:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792413568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330231.709428:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330231.709573:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792413568 00000100:00100000:2.0:1788330231.709584:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792413568 00000100:00100000:2.0:1788330231.709659:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788330231.709673:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792413568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330231.709713:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330231.709771:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792413568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330231.709779:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:2.0:1788330231.709809:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330231.709853:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788330231.709861:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1788330231.709887:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99edc8456680, transno 4294967311 00000100:00100000:2.0:1788330231.709910:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792413568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330231.715218:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330231.715251:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792413696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788330231.715351:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330231.715459:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792413696 00000100:00100000:0.0:1788330231.715471:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792413696 00000100:00100000:0.0:1788330231.715557:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788330231.715570:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792413696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788330231.715603:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330231.715664:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792413696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330231.715672:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:0.0:1788330231.715701:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330231.715749:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792413696:0@lo:13:osp-pre-0-1.0 00000001:00080000:3.0:1788330231.722553:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1788330231.722593:0:6501:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99edc665c780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788330231.722600:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99eef6d81300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99edc665c840 00000020:00080000:3.0:1788330231.722604:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99eef6d81800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99edc76d8a00 00000020:00080000:3.0:1788330231.722628:0:6501:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:3.0:1788330231.722657:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1ee2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330231.722672:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1ee2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330231.722681:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1ee2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330231.722689:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330231.722694:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1ee2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330231.722703:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1ee2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330231.722740:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff99eec91ded00) 00010000:00010000:3.0:1788330231.722744:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330231.722751:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1ee2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330231.722758:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd1ee2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788330231.722800:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788330231.722897:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1788330232.222303:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967326 is committed 00000001:00080000:2.0:1788330232.222323:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000100:00100000:1.0:1788330232.731551:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330232.731588:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792413824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330232.731712:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330232.731836:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330232.731881:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792413824 00000100:00100000:2.0:1788330232.731892:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792413824 00000100:00100000:2.0:1788330232.731954:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788330232.731967:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792413824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788330232.732032:0:7831:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788330232.732504:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792413824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 537us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330232.732515:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788330232.735392:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792413824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330233.248569:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792413952:0@lo:400:kworker.0 00000100:00100000:0.0:1788330233.248653:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792414080:0@lo:400:kworker.0 00000100:00100000:1.0:1788330233.248679:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330233.248690:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330233.248755:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792414336:0@lo:400:kworker.0 00000100:00100000:2.0:1788330233.248790:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330233.248846:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792414080 00000100:00100000:2.0:1788330233.248856:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792414080 00000100:00100000:2.0:1788330233.248936:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792414336 00000100:00100000:2.0:1788330233.248940:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792414336 00000100:00100000:1.0:1788330233.249076:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792414464:0@lo:400:kworker.0 00000100:00100000:1.0:1788330233.249114:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330233.249121:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792414848:0@lo:400:kworker.0 00000100:00100000:1.0:1788330233.249135:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792414976:0@lo:400:kworker.0 00000100:00100000:3.0:1788330233.249175:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330233.249185:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792413952 00000100:00100000:1.0:1788330233.249189:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792413952 00000100:00100000:3.0:1788330233.249199:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792415360:0@lo:400:kworker.0 00000100:00100000:3.0:1788330233.249221:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330233.249231:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1788330233.249243:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3649:x1875199792413952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330233.249308:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3649:x1875199792413952:12345-0@lo:400:kworker.0 Request processed in 65us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330233.249316:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1788330233.249359:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792414464 00000100:00100000:1.0:1788330233.249363:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792414464 00000100:00100000:1.0:1788330233.249397:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788330233.249405:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792414464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330233.249443:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792414464:12345-0@lo:400:kworker.0 Request processed in 38us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330233.249461:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788330233.249482:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792414848 00000100:00100000:1.0:1788330233.249486:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792414848 00000100:00100000:1.0:1788330233.249541:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792415360 00000100:00100000:1.0:1788330233.249544:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792415360 00000100:00100000:1.0:1788330233.249572:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788330233.249579:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792414848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330233.249616:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792414848:12345-0@lo:400:kworker.0 Request processed in 38us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330233.249622:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788330233.249634:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788330233.249640:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792415360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330233.249668:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792415360:12345-0@lo:400:kworker.0 Request processed in 29us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330233.249673:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788330233.249733:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792414848:0@lo:400:kworker.0 00000100:00100000:1.0:1788330233.249744:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792415360:0@lo:400:kworker.0 00000100:00100000:1.0:1788330233.249772:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330233.249796:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792415488:0@lo:400:kworker.0 00000100:00100000:1.0:1788330233.249820:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330233.249844:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3649:1875199792413952:0@lo:400:kworker.0 00000100:00100000:1.0:1788330233.249862:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792414464:0@lo:400:kworker.0 00000100:00100000:1.0:1788330233.249881:0:13829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792414976 00000100:00100000:1.0:1788330233.249883:0:13829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792414976 00000100:00100000:1.0:1788330233.249916:0:13829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792415488 00000100:00100000:1.0:1788330233.249920:0:13829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792415488 00000100:00100000:1.0:1788330233.249939:0:13829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788330233.249945:0:13829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792414976:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788330233.250033:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330233.250039:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330233.250182:0:13829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792414976:12345-0@lo:400:kworker.0 Request processed in 236us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330233.250189:0:13829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788330233.250193:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792414976:0@lo:400:kworker.0 00000100:00100000:1.0:1788330233.250201:0:13829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788330233.250208:0:13829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792415488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330233.250248:0:13829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792415488:12345-0@lo:400:kworker.0 Request processed in 40us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330233.250255:0:13829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788330233.250274:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792414592:0@lo:400:kworker.0 00000100:00100000:0.0:1788330233.250309:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330233.250339:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792415104:0@lo:400:kworker.0 00000100:00100000:2.0:1788330233.250357:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792414592 00000100:00100000:2.0:1788330233.250362:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792414592 00000100:00100000:0.0:1788330233.250362:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330233.250378:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788330233.250381:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792415104 00000100:00100000:2.0:1788330233.250383:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792415104 00000100:00100000:2.0:1788330233.250397:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788330233.250406:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792414080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330233.250447:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792414080:12345-0@lo:400:kworker.0 Request processed in 43us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330233.250453:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788330233.250470:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00080000:3.0:1788330233.250477:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330233.250477:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792414336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330233.250494:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:3.0:1788330233.250501:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967326 committed transno 4294967326 00000100:00100000:2.0:1788330233.250510:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792414336:12345-0@lo:400:kworker.0 Request processed in 35us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330233.250517:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1788330233.250519:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792415488:0@lo:400:kworker.0 00000100:00100000:2.0:1788330233.250528:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788330233.250534:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792414592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330233.250559:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792414592:12345-0@lo:400:kworker.0 Request processed in 26us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330233.250560:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792414208:0@lo:400:kworker.0 00000100:00100000:2.0:1788330233.250566:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788330233.250576:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788330233.250582:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792415104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330233.250587:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330233.250609:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792415104:12345-0@lo:400:kworker.0 Request processed in 27us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330233.250617:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792414720:0@lo:400:kworker.0 00000100:00100000:2.0:1788330233.250624:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1788330233.250659:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330233.250676:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792415232:0@lo:400:kworker.0 00000100:00100000:0.0:1788330233.250696:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330233.250715:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792414080:0@lo:400:kworker.0 00000100:00100000:0.0:1788330233.250723:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792414592:0@lo:400:kworker.0 00000100:00100000:0.0:1788330233.250730:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792415104:0@lo:400:kworker.0 00000100:00100000:0.0:1788330233.250761:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792414720 00000100:00100000:0.0:1788330233.250764:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792414720 00000100:00100000:0.0:1788330233.250795:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792415232 00000100:00100000:0.0:1788330233.250798:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792415232 00000100:00100000:0.0:1788330233.250815:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788330233.250821:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792414720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330233.250858:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792414720:12345-0@lo:400:kworker.0 Request processed in 36us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330233.250863:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788330233.250877:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1788330233.250883:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792415232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330233.250908:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792415232:12345-0@lo:400:kworker.0 Request processed in 26us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330233.250913:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788330233.251025:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792414208 00000100:00100000:3.0:1788330233.251029:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792414208 00000100:00100000:3.0:1788330233.251059:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788330233.251067:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792414208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330233.251105:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792414208:12345-0@lo:400:kworker.0 Request processed in 40us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330233.251117:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788330233.251322:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792414336:0@lo:400:kworker.0 00000100:00080000:0.0:1788330233.255540:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788330233.255619:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792414208:0@lo:400:kworker.0 00010000:00080000:0.0:1788330233.255664:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72ff100 x1875199792414720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330233.255676:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792414720:0@lo:400:kworker.0 00010000:00080000:0.0:1788330233.255689:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fd880 x1875199792415232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330233.255697:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792415232:0@lo:400:kworker.0 00000100:00100000:0.0:1788330233.577438:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330233.577484:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330233.577507:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330233.577530:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330233.577547:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330233.577565:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330233.577613:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330233.578460:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766149632 00000100:00100000:0.0:1788330233.578477:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766149632 00000100:00100000:0.0:1788330233.578550:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 399 00000100:00100000:0.0:1788330233.578563:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2411:x1875199766149632:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330233.578665:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2411:x1875199766149632:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 104us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330233.578675:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 399 00000100:00100000:0.0:1788330233.578723:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766149888 00000100:00100000:0.0:1788330233.578727:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766149888 00000100:00100000:0.0:1788330233.578770:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766150400 00000100:00100000:0.0:1788330233.578774:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766150400 00000100:00100000:0.0:1788330233.578787:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766149760 00000100:00100000:0.0:1788330233.578789:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766149760 00000100:00100000:0.0:1788330233.578824:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766150272 00000100:00100000:0.0:1788330233.578827:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766150272 00000100:00100000:0.0:1788330233.578843:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 376 00000100:00100000:0.0:1788330233.578850:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766149888:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330233.578884:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766149888:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 35us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330233.578891:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 376 00000100:00100000:0.0:1788330233.578904:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 377 00000100:00100000:0.0:1788330233.578911:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766150400:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330233.578935:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766150400:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 24us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330233.578942:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 377 00000100:00100000:0.0:1788330233.578954:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 378 00000100:00100000:0.0:1788330233.578960:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:2411:x1875199766149760:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330233.579004:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:2411:x1875199766149760:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 44us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330233.579010:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 378 00000100:00100000:0.0:1788330233.579022:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 379 00000100:00100000:0.0:1788330233.579028:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766150272:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330233.579051:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766150272:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 23us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330233.579057:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 379 00000100:00100000:0.0:1788330233.579079:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766150144 00000100:00100000:0.0:1788330233.579083:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766150144 00000100:00100000:0.0:1788330233.579124:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766150016 00000100:00100000:0.0:1788330233.579128:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766150016 00000100:00100000:0.0:1788330233.579175:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 166 00000100:00100000:0.0:1788330233.579183:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2411:x1875199766150144:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330233.579212:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2411:x1875199766150144:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 30us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330233.579217:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 166 00000100:00100000:0.0:1788330233.579229:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 167 00000100:00100000:0.0:1788330233.579235:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766150016:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330233.579259:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766150016:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 25us (1693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330233.579265:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 167 00000100:00080000:0.0:1788330233.579458:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788330233.579463:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330233.579466:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330233.579468:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788330233.705561:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330233.705784:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766150528 00000100:00100000:0.0:1788330233.705799:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766150528 00000100:00100000:0.0:1788330233.705882:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 255 00000100:00100000:0.0:1788330233.705897:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:12161:x1875199766150528:12345-192.168.202.50@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788330233.706089:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:12161:x1875199766150528:12345-192.168.202.50@tcp:60:lhsmtool_posix.0 Request processed in 196us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330233.706097:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 255 00000100:00100000:0.0:1788330233.708642:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330233.708788:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766150656 00000100:00100000:1.0:1788330233.708801:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766150656 00000100:00100000:1.0:1788330233.708874:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 256 00000100:00100000:1.0:1788330233.708887:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:12161:x1875199766150656:12345-192.168.202.50@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788330233.709046:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:12161:x1875199766150656:12345-192.168.202.50@tcp:60:lhsmtool_posix.0 Request processed in 161us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330233.709055:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 256 00000100:00100000:2.0:1788330233.713140:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330233.713399:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766150912 00000100:00100000:1.0:1788330233.713414:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766150912 00000100:00100000:1.0:1788330233.713493:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 65 00000100:00100000:1.0:1788330233.713505:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:12161:x1875199766150912:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788330233.713844:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:12161:x1875199766150912:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 339us (725us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788330233.713867:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 65 00010000:00010000:2.0:1788330233.755370:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330234.053031:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330234.053236:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766151040 00000100:00100000:1.0:1788330234.053252:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766151040 00000100:00100000:1.0:1788330234.053332:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 257 00000100:00100000:1.0:1788330234.053346:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:12966:x1875199766151040:12345-192.168.202.50@tcp:101:lsof.0 00010000:00010000:1.0:1788330234.053373:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330234.053401:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7efa00/0x8475908e9fd1f6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61061c2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330234.053488:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee800/0x8475908e9fd1f75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330234.053505:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee800/0x8475908e9fd1f75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330234.053521:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee800/0x8475908e9fd1f75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330234.053597:0:6523:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788330234.053602:0:6523:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788330234.053633:0:6523:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee800/0x8475908e9fd1f75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330234.053673:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7efa00/0x8475908e9fd1f6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061c2 expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330234.053696:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee800/0x8475908e9fd1f75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061c2 expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330234.053732:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95d00) 00010000:00010000:1.0:1788330234.053735:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788330234.053739:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eefe7ee800, rc 0) 00000100:00100000:1.0:1788330234.053827:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:12966:x1875199766151040:12345-192.168.202.50@tcp:101:lsof.0 Request processed in 483us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330234.053835:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 257 00010000:00010000:2.0:1788330234.780576:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330235.291710:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792415616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330235.291822:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330235.292315:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330235.292325:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792415744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330235.292360:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330235.292455:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792415616 00000100:00100000:3.0:1788330235.292466:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792415616 00000100:00100000:3.0:1788330235.292538:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788330235.292551:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792415616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788330235.292600:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788330235.292669:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792415616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330235.292676:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788330235.292774:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792415616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330235.292902:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792415744 00000100:00100000:1.0:1788330235.292908:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792415744 00000100:00100000:1.0:1788330235.292979:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788330235.293002:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792415744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330235.293027:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788330235.293067:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792415744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330235.293074:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1788330235.293256:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330235.293285:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792415744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330235.294354:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330235.294375:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792415872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788330235.294451:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330235.294565:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792415872 00000100:00100000:0.0:1788330235.294585:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792415872 00000100:00100000:0.0:1788330235.294662:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788330235.294673:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792415872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788330235.294696:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788330235.294743:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792415872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330235.294751:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788330235.294897:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792415872:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788330235.296783:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788330235.803781:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330236.831523:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330236.832236:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330236.832266:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792416128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330236.832363:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330236.832571:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792416128 00000100:00100000:3.0:1788330236.832583:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792416128 00000100:00100000:3.0:1788330236.832661:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788330236.832674:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792416128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788330236.832713:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330236.832767:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792416128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330236.832776:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788330236.832805:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792416000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330236.832831:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330236.832862:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792416000 00000100:00100000:3.0:1788330236.832865:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792416000 00000100:00100000:3.0:1788330236.832900:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788330236.832905:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792416000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330236.832915:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330236.832954:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792416000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330236.832960:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788330236.833007:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792416000:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788330236.833083:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330236.833109:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792416128:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788330237.855647:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330237.872473:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792416256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330237.872584:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330237.872684:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792416256 00000100:00100000:1.0:1788330237.872695:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792416256 00000100:00100000:1.0:1788330237.872757:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788330237.872786:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792416256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788330237.872834:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788330237.872895:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792416256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330237.872904:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788330237.872984:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792416256:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1788330237.874780:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:2.0:1788330237.874804:0:6501:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788330237.874937:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788330237.874952:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:0.0:1788330238.061180:0:14918:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 02:23:56 (1788330236) 00000100:00100000:1.0:1788330238.365326:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792416512:0@lo:400:kworker.0 00000100:00100000:1.0:1788330238.365952:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330238.366036:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792416384:0@lo:400:kworker.0 00000100:00100000:0.0:1788330238.366099:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330238.366183:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792416896:0@lo:400:kworker.0 00000100:00100000:0.0:1788330238.366214:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330238.366237:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792417408:0@lo:400:kworker.0 00000100:00100000:0.0:1788330238.366263:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330238.366282:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792417920:0@lo:400:kworker.0 00000100:00100000:0.0:1788330238.366305:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330238.366383:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792416896 00000100:00100000:0.0:1788330238.366394:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792416896 00000100:00100000:1.0:1788330238.366534:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792417024:0@lo:400:kworker.0 00000100:00100000:1.0:1788330238.366561:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330238.366577:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792417536:0@lo:400:kworker.0 00000100:00100000:1.0:1788330238.366597:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330238.367582:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788330238.367600:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792416896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330238.367705:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792416896:12345-0@lo:400:kworker.0 Request processed in 111us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330238.367714:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788330238.367805:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792416896:0@lo:400:kworker.0 00000100:00100000:3.0:1788330238.370703:0:13409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792417408 00000100:00100000:3.0:1788330238.370725:0:13409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792417408 00000100:00100000:3.0:1788330238.370813:0:13409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792417920 00000100:00100000:3.0:1788330238.370816:0:13409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792417920 00000100:00100000:3.0:1788330238.370850:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788330238.370864:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792417408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330238.371113:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792417408:12345-0@lo:400:kworker.0 Request processed in 251us (4846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330238.371123:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788330238.371147:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788330238.371193:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792417920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330238.371232:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792417920:12345-0@lo:400:kworker.0 Request processed in 42us (4926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330238.371239:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:3.0:1788330238.371271:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330238.371276:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330238.371333:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792417408:0@lo:400:kworker.0 00000100:00100000:3.0:1788330238.371351:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792417920:0@lo:400:kworker.0 00000100:00100000:1.0:1788330238.372430:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792416512 00000100:00100000:1.0:1788330238.372445:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792416512 00000100:00100000:1.0:1788330238.372497:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792417024 00000100:00100000:1.0:1788330238.372501:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792417024 00000100:00100000:1.0:1788330238.372530:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792417536 00000100:00100000:1.0:1788330238.372534:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792417536 00000100:00100000:1.0:1788330238.372553:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1788330238.372561:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792416512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330238.372646:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792416512:12345-0@lo:400:kworker.0 Request processed in 85us (6698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330238.372654:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1788330238.372672:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788330238.372679:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792417024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330238.372706:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792417024:12345-0@lo:400:kworker.0 Request processed in 29us (6146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330238.372723:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788330238.372735:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788330238.372742:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792417536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330238.372786:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792417536:12345-0@lo:400:kworker.0 Request processed in 32us (6174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330238.372792:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788330238.372863:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792416512:0@lo:400:kworker.0 00000100:00100000:1.0:1788330238.372878:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792417024:0@lo:400:kworker.0 00000100:00100000:1.0:1788330238.372889:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792417536:0@lo:400:kworker.0 00000100:00080000:3.0:1788330238.375107:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330238.376224:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792416384 00000100:00100000:0.0:1788330238.376240:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792416384 00000100:00100000:0.0:1788330238.376306:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1788330238.376319:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3648:x1875199792416384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330238.376447:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3648:x1875199792416384:12345-0@lo:400:kworker.0 Request processed in 131us (10347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330238.376456:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1788330238.376516:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792416768:0@lo:400:kworker.0 00000100:00100000:0.0:1788330238.376561:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330238.376597:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792417280:0@lo:400:kworker.0 00000100:00100000:0.0:1788330238.376621:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330238.376640:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792417792:0@lo:400:kworker.0 00000100:00100000:0.0:1788330238.376660:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330238.376688:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788330238.376698:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792416640:0@lo:400:kworker.0 00000100:00100000:0.0:1788330238.376723:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330238.376747:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792417152:0@lo:400:kworker.0 00000100:00100000:3.0:1788330238.376830:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792416384:0@lo:400:kworker.0 00000100:00100000:0.0:1788330238.376863:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330238.376898:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792417664:0@lo:400:kworker.0 00000100:00100000:0.0:1788330238.376931:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330238.376983:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792416768 00000100:00100000:0.0:1788330238.377038:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792417152 00000100:00100000:3.0:1788330238.377041:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792416768 00000100:00100000:0.0:1788330238.377044:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792417152 00000100:00100000:3.0:1788330238.377082:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1788330238.377090:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792416768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330238.377142:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792416768:12345-0@lo:400:kworker.0 Request processed in 53us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330238.377164:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788330238.377882:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792417664 00000100:00100000:0.0:1788330238.377891:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792417664 00000100:00100000:0.0:1788330238.377933:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788330238.377942:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792417152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330238.378079:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875199792417152:12345-0@lo:400:kworker.0 Request processed in 137us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330238.378173:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788330238.378193:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788330238.378200:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792417664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330238.378232:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792417664:12345-0@lo:400:kworker.0 Request processed in 33us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330238.378239:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788330238.378264:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792417280 00000100:00100000:0.0:1788330238.378268:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792417280 00000100:00100000:0.0:1788330238.378302:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792417792 00000100:00100000:0.0:1788330238.378305:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792417792 00000100:00100000:0.0:1788330238.378330:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788330238.378337:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792417280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330238.378372:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792417280:12345-0@lo:400:kworker.0 Request processed in 36us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330238.378379:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788330238.378391:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788330238.378407:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792417792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330238.378442:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792417792:12345-0@lo:400:kworker.0 Request processed in 36us (1781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330238.378447:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788330238.378473:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792416640 00000100:00100000:0.0:1788330238.378477:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792416640 00000100:00100000:0.0:1788330238.378502:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788330238.378508:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792416640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330238.378545:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792416640:12345-0@lo:400:kworker.0 Request processed in 38us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330238.378551:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788330238.380063:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792416640:0@lo:400:kworker.0 00010000:00080000:1.0:1788330238.380181:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fd880 x1875199792417152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330238.380195:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792417152:0@lo:400:kworker.0 00010000:00080000:1.0:1788330238.380213:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc72fc000 x1875199792417664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330238.380223:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792417664:0@lo:400:kworker.0 00000100:00100000:1.0:1788330238.380239:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792416768:0@lo:400:kworker.0 00000100:00100000:1.0:1788330238.380254:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792417280:0@lo:400:kworker.0 00000100:00100000:1.0:1788330238.380268:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792417792:0@lo:400:kworker.0 00000100:00080000:3.0:1788330238.383360:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330238.383374:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330238.383380:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:1.0:1788330238.428124:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788330238.683487:0:13809:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788330238.683501:0:13809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788330238.683624:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788330238.683632:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788330238.702147:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330238.702282:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766151168 00000100:00100000:1.0:1788330238.702298:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766151168 00000100:00100000:1.0:1788330238.702380:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 401 00000100:00100000:1.0:1788330238.702395:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2413:x1875199766151168:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330238.702514:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2413:x1875199766151168:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 122us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330238.702524:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 401 00000100:00100000:3.0:1788330238.712455:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330238.714060:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330238.714114:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330238.714139:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330238.714199:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330238.714201:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766151296 00000100:00100000:2.0:1788330238.714216:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766151296 00000100:00100000:3.0:1788330238.714233:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330238.714266:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766151424 00000100:00100000:3.0:1788330238.714272:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766151424 00000100:00100000:2.0:1788330238.714310:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766151808 00000100:00100000:3.0:1788330238.714311:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766151936 00000100:00100000:2.0:1788330238.714315:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766151808 00000100:00100000:3.0:1788330238.714317:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766151936 00000100:00100000:2.0:1788330238.714346:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 386 00000100:00100000:2.0:1788330238.714359:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:2413:x1875199766151296:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330238.714464:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:2413:x1875199766151296:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 108us (2026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330238.719880:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766151552 00000100:00100000:0.0:1788330238.719903:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766151552 00000100:00100000:0.0:1788330238.719998:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766151680 00000100:00100000:0.0:1788330238.720002:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766151680 00000100:00100000:0.0:1788330238.720037:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 172 00000100:00100000:0.0:1788330238.720049:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766151552:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330238.720450:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 387 00000100:00100000:3.0:1788330238.720466:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766151424:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330238.720531:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766151424:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 71us (6484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330238.720540:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 387 00000100:00100000:3.0:1788330238.720571:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 388 00000100:00100000:3.0:1788330238.720580:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2411:x1875199766151808:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330238.720609:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2411:x1875199766151808:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 31us (6410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330238.720616:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 388 00000100:00100000:3.0:1788330238.720633:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 389 00000100:00100000:3.0:1788330238.720641:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766151936:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330238.721295:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2411:x1875199766151552:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 1240us (7172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330238.721307:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 172 00000100:00100000:0.0:1788330238.721333:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 173 00000100:00100000:0.0:1788330238.721342:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2411:x1875199766151680:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330238.721388:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2411:x1875199766151680:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 48us (7248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330238.721394:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 173 00000100:00100000:2.0:1788330238.723662:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 386 00000100:00080000:2.0:1788330238.723733:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330238.723741:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788330238.723746:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788330238.723749:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330238.728360:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2411:x1875199766151936:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 7700us (14107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330238.728382:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 389 00010000:00010000:3.0:1788330238.877402:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330239.899305:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330240.411416:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792418048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330240.411529:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330240.411681:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792418048 00000100:00100000:0.0:1788330240.411693:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792418048 00000100:00100000:0.0:1788330240.411773:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788330240.411787:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792418048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788330240.411827:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788330240.411886:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792418048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330240.411894:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:2.0:1788330240.412070:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788330240.412118:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792418048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330240.412396:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792418176:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330240.412444:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330240.412493:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792418176 00000100:00100000:3.0:1788330240.412499:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792418176 00000100:00100000:3.0:1788330240.412534:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788330240.412542:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792418176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788330240.412573:0:6527:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788330240.412630:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792418176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330240.412636:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788330240.412688:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792418176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330240.413918:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330240.413948:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792418304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330240.414015:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330240.414123:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792418304 00000100:00100000:0.0:1788330240.414133:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792418304 00000100:00100000:0.0:1788330240.414224:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788330240.414235:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792418304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788330240.414262:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788330240.414319:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792418304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330240.414327:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:2.0:1788330240.414407:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788330240.414449:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792418304:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788330240.925985:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330241.948183:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788330241.948221:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc72fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792418432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788330241.948334:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330241.948646:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792418432 00000100:00100000:1.0:1788330241.948660:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792418432 00000100:00100000:1.0:1788330241.948744:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00010000:00010000:3.0:1788330241.948753:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330241.948758:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792418432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788330241.948803:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788330241.948875:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792418432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330241.948884:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788330241.948962:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc72fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792418432:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788330241.949734:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330241.955227:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792418560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330241.955345:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330241.956437:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792418560 00000100:00100000:0.0:1788330241.956453:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792418560 00000100:00100000:0.0:1788330241.956561:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788330241.956576:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792418560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788330241.956624:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788330241.956738:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792418560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330241.956746:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788330241.957050:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792418560:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788330241.957414:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788330242.971369:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330242.972988:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792418688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330242.973104:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330242.973962:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792418688 00000100:00100000:1.0:1788330242.973979:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792418688 00000100:00100000:1.0:1788330242.974068:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788330242.974082:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792418688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788330242.974134:0:7831:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788330242.974803:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792418688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330242.974862:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792418688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 782us (1756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330242.974871:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788330243.407733:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330243.407989:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766152192 00000100:00100000:1.0:1788330243.408004:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766152192 00000100:00100000:3.0:1788330243.408277:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 66 00000100:00100000:3.0:1788330243.408293:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+18:13190:x1875199766152192:12345-192.168.202.50@tcp:35:umount.0 00000100:00100000:3.0:1788330243.408663:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:13190:x1875199766152192:12345-192.168.202.50@tcp:35:umount.0 Request processed in 372us (945us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788330243.408672:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 66 00000100:00100000:0.0:1788330243.414595:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330243.414893:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766152448 00000100:00100000:1.0:1788330243.414915:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766152448 00000100:00100000:1.0:1788330243.415011:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00100000:1.0:1788330243.415025:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+19:13190:x1875199766152448:12345-192.168.202.50@tcp:35:umount.0 00000100:00100000:1.0:1788330243.415882:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+20:13190:x1875199766152448:12345-192.168.202.50@tcp:35:umount.0 Request processed in 846us (1293us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788330243.415892:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 67 00000100:00080000:2.0:1788330243.416052:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330243.424209:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330243.424362:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766152704 00000100:00100000:3.0:1788330243.424374:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766152704 00000100:00100000:3.0:1788330243.424442:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 68 00000100:00100000:3.0:1788330243.424453:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9242050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+20:13190:x1875199766152704:12345-192.168.202.50@tcp:35:umount.0 00000100:00100000:3.0:1788330243.424719:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9242050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:13190:x1875199766152704:12345-192.168.202.50@tcp:35:umount.0 Request processed in 268us (523us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788330243.424727:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 68 00000100:00100000:0.0:1788330243.429812:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330243.430254:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766152960 00000100:00100000:3.0:1788330243.430267:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766152960 00000100:00100000:3.0:1788330243.430388:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 69 00000100:00100000:3.0:1788330243.430401:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+21:13190:x1875199766152960:12345-192.168.202.50@tcp:35:umount.0 00000100:00100000:3.0:1788330243.430780:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:13190:x1875199766152960:12345-192.168.202.50@tcp:35:umount.0 Request processed in 380us (978us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1788330243.430788:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 69 00000100:00100000:0.0:1788330243.445743:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330243.445816:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330243.445891:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330243.445957:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766153600 00000100:00100000:3.0:1788330243.445969:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766153600 00000100:00100000:3.0:1788330243.446049:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766153472 00000100:00100000:3.0:1788330243.446052:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766153472 00000100:00100000:3.0:1788330243.446073:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:3.0:1788330243.446083:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa3490c8-da14-415b-81e3-af4ba0c476db+14:2412:x1875199766153600:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330243.446098:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330243.446120:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c3e00/0x8475908e9fd0e8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105cd6 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330243.446140:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330243.446221:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa3490c8-da14-415b-81e3-af4ba0c476db+13:2412:x1875199766153600:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 138us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330243.446230:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:3.0:1788330243.446250:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:3.0:1788330243.446256:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa3490c8-da14-415b-81e3-af4ba0c476db+12:2412:x1875199766153472:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330243.446266:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330243.446276:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c3200/0x8475908e9fd0f4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d15 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330243.446286:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330243.446304:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa3490c8-da14-415b-81e3-af4ba0c476db+11:2412:x1875199766153472:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 48us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330243.446310:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:0.0:1788330243.451414:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330243.453146:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766153728 00000100:00100000:2.0:1788330243.453178:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766153728 00000100:00100000:1.0:1788330243.453340:0:13409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766153344 00000100:00100000:1.0:1788330243.453345:0:13409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766153344 00000100:00100000:1.0:1788330243.453408:0:13409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 81 00000100:00100000:1.0:1788330243.453421:0:13409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+7:2409:x1875199766153344:12345-192.168.202.50@tcp:9:umount.0 00000020:00000080:1.0:1788330243.453458:0:13409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd14e0 00000020:00010000:1.0:1788330243.453478:0:13409:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99eec865c800: total 0 00000100:00080000:1.0:1788330243.453490:0:13409:0:(import.c:65:import_set_state_nolock()) ffff99eec8659000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788330243.453546:0:13409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:1.0:1788330243.453753:0:13409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2409:x1875199766153344:12345-192.168.202.50@tcp:9:umount.0 Request processed in 334us (2349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330243.453762:0:13409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 81 00000100:00080000:0.0:1788330243.454202:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:0.0:1788330243.454219:0:6510:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99eec865c800: total 0 00010000:00010000:0.0:1788330243.454261:0:6510:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99eec865c800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788330243.454320:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd72b2f5/0x8475908e9fd1f67 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061bb expref: 4 pid: 13829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330243.454358:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8d068c7/0x8475908e9fd1898 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fd8 expref: 3 pid: 13829 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330243.454374:0:6510:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99eec865c800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788330243.454387:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330243.454389:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330243.454390:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330243.462784:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:2.0:1788330243.462815:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7effb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa3490c8-da14-415b-81e3-af4ba0c476db+11:2412:x1875199766153728:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330243.462837:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330243.462861:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef59cbc00/0x8475908e9fd1167 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105dee expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330243.462893:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330243.462971:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7effb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2412:x1875199766153728:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 173us (17079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330243.462979:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:1.0:1788330243.470211:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330243.470265:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766153856 00000100:00100000:2.0:1788330243.470276:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766153856 00000100:00100000:2.0:1788330243.470398:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 82 00000100:00100000:2.0:1788330243.470411:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2409:x1875199766153856:12345-192.168.202.50@tcp:9:umount.0 00000020:00000080:2.0:1788330243.470477:0:8440:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd126a 00000100:00080000:2.0:1788330243.470500:0:8440:0:(import.c:65:import_set_state_nolock()) ffff99edc7c0b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788330243.470549:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788330243.470730:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+2:2409:x1875199766153856:12345-192.168.202.50@tcp:9:umount.0 Request processed in 322us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330243.470738:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 82 00000100:00080000:3.0:1788330243.470844:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788330243.470857:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330243.481866:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330243.482021:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766154880 00000100:00100000:0.0:1788330243.482033:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766154880 00000100:00100000:0.0:1788330243.482092:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 258 00000100:00100000:0.0:1788330243.482102:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef59ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+22:2409:x1875199766154880:12345-192.168.202.50@tcp:39:umount.0 00000020:00000080:0.0:1788330243.482135:0:7832:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0e9d 00000020:00010000:0.0:1788330243.482183:0:7832:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99edc5f34800: total 0 00000100:00080000:0.0:1788330243.482206:0:7832:0:(import.c:65:import_set_state_nolock()) ffff99edc5c6a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788330243.482245:0:7832:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:3.0:1788330243.482401:0:10341:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99edc5f34800: total 0 00010000:00010000:3.0:1788330243.482458:0:10341:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99edc5f34800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788330243.482500:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:3.0:1788330243.482504:0:10341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788330243.482513:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd1779 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105f8b expref: 21 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330243.482758:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99edc65db300) 00010000:00010000:3.0:1788330243.482761:0:10341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330243.482767:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765b600/0x8475908e9fd11c9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105dfc expref: 20 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330243.482787:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:3.0:1788330243.482789:0:10341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788330243.482794:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd191d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ffb expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330243.482810:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:3.0:1788330243.482813:0:10341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788330243.482818:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1326c00/0x8475908e9fd1f52 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061b4 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330243.482831:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:3.0:1788330243.482833:0:10341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788330243.482837:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99edc765a800/0x8475908e9fd1240 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e18 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330243.482849:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:3.0:1788330243.482851:0:10341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788330243.482855:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038600/0x8475908e9fd1f28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061a6 expref: 16 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330243.482892:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef59ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+15:2409:x1875199766154880:12345-192.168.202.50@tcp:39:umount.0 Request processed in 788us (1032us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1788330243.482903:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 258 00000100:00100000:2.0:1788330243.483508:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792418944:0@lo:400:kworker.0 00000100:00100000:2.0:1788330243.483556:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788330243.483795:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95d00) 00010000:00010000:1.0:1788330243.483799:0:10341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788330243.483807:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd1901 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ff4 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330243.483839:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:1.0:1788330243.483842:0:10341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788330243.483846:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039600/0x8475908e9fd1859 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fc3 expref: 13 pid: 12916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330243.483859:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff99eec91dee00) 00010000:00010000:1.0:1788330243.483861:0:10341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788330243.483865:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd1c0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61060d4 expref: 12 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330243.483897:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff99eec91deb00) 00010000:00010000:1.0:1788330243.483899:0:10341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788330243.483903:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd153b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105ef1 expref: 11 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330243.483918:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99eec9216d00) 00010000:00010000:1.0:1788330243.483920:0:10341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330243.483924:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79000/0x8475908e9fd11e5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105e03 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330243.483937:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff99edc75acd00) 00010000:00010000:1.0:1788330243.483940:0:10341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330243.483944:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd1e48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610616e expref: 9 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330243.483959:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff99edc75acf00) 00010000:00010000:1.0:1788330243.483962:0:10341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788330243.483972:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef59ca200/0x8475908e9fd1883 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105fd1 expref: 8 pid: 7832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330243.483985:0:10341:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99edc5f34800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788330243.484012:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330243.484015:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330243.484017:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330243.484030:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792418816:0@lo:400:kworker.0 00000100:00100000:1.0:1788330243.484082:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330243.490335:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792419456:0@lo:400:kworker.0 00000100:00100000:2.0:1788330243.490420:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330243.491290:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792418944 00000100:00100000:0.0:1788330243.491304:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792418944 00000100:00100000:0.0:1788330243.491378:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792419456 00000100:00100000:0.0:1788330243.491382:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792419456 00000100:00100000:0.0:1788330243.491422:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1788330243.491433:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792418944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330243.491512:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792418944:12345-0@lo:400:kworker.0 Request processed in 81us (7955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330243.491752:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1788330243.491778:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1788330243.491786:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792419456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330243.491821:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792419456:12345-0@lo:400:kworker.0 Request processed in 36us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330243.491828:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1788330243.491839:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792419968:0@lo:400:kworker.0 00000100:00080000:0.0:1788330243.491859:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330243.491894:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330243.491962:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792418944:0@lo:400:kworker.0 00000100:00100000:2.0:1788330243.491975:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792419456:0@lo:400:kworker.0 00000100:00100000:2.0:1788330243.491997:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788330243.492004:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792419072:0@lo:400:kworker.0 00000100:00100000:2.0:1788330243.492033:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330243.492078:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792419200:0@lo:400:kworker.0 00000100:00100000:0.0:1788330243.492111:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330243.492134:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792419712:0@lo:400:kworker.0 00000100:00100000:0.0:1788330243.492187:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330243.492207:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792420224:0@lo:400:kworker.0 00000100:00100000:0.0:1788330243.492240:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330243.492985:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792419712 00000100:00100000:0.0:1788330243.492993:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792419712 00000100:00100000:2.0:1788330243.493000:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792419584:0@lo:400:kworker.0 00000100:00100000:2.0:1788330243.493033:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330243.493110:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792420224 00000100:00100000:0.0:1788330243.493114:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792420224 00000100:00100000:1.0:1788330243.493189:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792419328:0@lo:400:kworker.0 00000100:00100000:0.0:1788330243.493190:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788330243.493202:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792419712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330243.493229:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330243.493252:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef59dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792419840:0@lo:400:kworker.0 00000100:00100000:0.0:1788330243.493274:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792419712:12345-0@lo:400:kworker.0 Request processed in 74us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330243.493285:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330243.493311:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792419840 00000100:00100000:1.0:1788330243.493315:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792419840 00000100:00100000:0.0:1788330243.493344:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788330243.493387:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792420096:0@lo:400:kworker.0 00000100:00100000:2.0:1788330243.493411:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330243.493428:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792418816 00000100:00100000:3.0:1788330243.493436:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792418816 00000100:00100000:2.0:1788330243.493444:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792419968 00000100:00100000:2.0:1788330243.493450:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792419968 00000100:00100000:3.0:1788330243.493475:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1788330243.493485:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792418816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330243.493536:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792418816:12345-0@lo:400:kworker.0 Request processed in 43us (9444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330243.493543:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1788330243.493573:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792419200 00000100:00100000:3.0:1788330243.493578:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792419200 00000100:00100000:3.0:1788330243.493595:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792419584 00000100:00100000:3.0:1788330243.493597:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792419584 00000100:00100000:3.0:1788330243.493610:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792420096 00000100:00100000:3.0:1788330243.493613:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792420096 00000100:00100000:3.0:1788330243.493627:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788330243.493633:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792419200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330243.493665:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792419200:12345-0@lo:400:kworker.0 Request processed in 32us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330243.493671:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788330243.493683:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1788330243.493689:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792419584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330243.493721:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792419584:12345-0@lo:400:kworker.0 Request processed in 33us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330243.493728:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1788330243.493739:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1788330243.493746:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792420096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330243.493785:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792420096:12345-0@lo:400:kworker.0 Request processed in 40us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330243.493792:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1788330243.493823:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792419072 00000100:00100000:3.0:1788330243.493827:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792419072 00000100:00100000:3.0:1788330243.493847:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792419328 00000100:00100000:3.0:1788330243.493849:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792419328 00000100:00100000:3.0:1788330243.493859:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788330243.493864:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792419072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330243.493906:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792419072:12345-0@lo:400:kworker.0 Request processed in 41us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330243.493912:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788330243.493924:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788330243.493929:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792419328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330243.493955:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792419328:12345-0@lo:400:kworker.0 Request processed in 25us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330243.493960:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788330243.495771:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1788330243.495786:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792419968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330243.495856:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792419968:12345-0@lo:400:kworker.0 Request processed in 75us (3962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330243.495863:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1788330243.495936:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792419072:0@lo:400:kworker.0 00010000:00080000:2.0:1788330243.495953:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eef59dc380 x1875199792419584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330243.495964:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792419584:0@lo:400:kworker.0 00010000:00080000:2.0:1788330243.495977:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc8588700 x1875199792420096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330243.495986:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792420096:0@lo:400:kworker.0 00000100:00100000:2.0:1788330243.495998:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792419968:0@lo:400:kworker.0 00000100:00100000:1.0:1788330243.496437:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788330243.496452:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792420224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330243.496699:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792420224:12345-0@lo:400:kworker.0 Request processed in 253us (4458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330243.496707:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788330243.496724:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788330243.496731:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792419840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330243.496763:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792419840:12345-0@lo:400:kworker.0 Request processed in 33us (3481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330243.496768:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788330243.496802:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792419840:0@lo:400:kworker.0 00000100:00100000:1.0:1788330243.496835:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792420352:0@lo:400:kworker.0 00000100:00100000:1.0:1788330243.496870:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330243.496910:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792420352 00000100:00100000:1.0:1788330243.496917:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792420352 00000100:00100000:1.0:1788330243.496947:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788330243.496953:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792420352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330243.496982:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792420352:12345-0@lo:400:kworker.0 Request processed in 29us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330243.496988:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788330243.497011:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792420352:0@lo:400:kworker.0 00000100:00100000:1.0:1788330243.497999:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792418816:0@lo:400:kworker.0 00000100:00100000:1.0:1788330243.498028:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792419328:0@lo:400:kworker.0 00000100:00080000:1.0:1788330243.498130:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788330243.498137:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788330243.498141:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788330243.498144:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330243.498206:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792419200:0@lo:400:kworker.0 00000100:00100000:1.0:1788330243.498218:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef59dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792419712:0@lo:400:kworker.0 00000100:00100000:1.0:1788330243.498230:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792420224:0@lo:400:kworker.0 00000100:00100000:1.0:1788330243.505377:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330243.505499:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766155008 00000100:00100000:2.0:1788330243.505511:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766155008 00000100:00100000:2.0:1788330243.505609:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 259 00000100:00100000:2.0:1788330243.505620:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+5:2409:x1875199766155008:12345-192.168.202.50@tcp:39:umount.0 00000020:00000080:2.0:1788330243.505669:0:12916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0ea4 00000100:00080000:2.0:1788330243.505691:0:12916:0:(import.c:65:import_set_state_nolock()) ffff99eeffce8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788330243.505728:0:12916:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:1.0:1788330243.506003:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788330243.506276:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3+3:2409:x1875199766155008:12345-192.168.202.50@tcp:39:umount.0 Request processed in 652us (907us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788330243.506286:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 259 00010000:00010000:0.0:1788330243.506825:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330243.812754:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330243.812825:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330243.813208:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766155264 00000100:00100000:2.0:1788330243.813237:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766155264 00000100:00080000:1.0:1788330243.813353:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788330243.813441:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766155136 00000100:00100000:2.0:1788330243.813445:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766155136 00000100:00080000:1.0:1788330243.813499:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330243.816533:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 396 00000100:00100000:0.0:1788330243.816561:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766155264:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330243.816669:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2410:x1875199766155264:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 122us (3929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330243.816677:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 396 00000100:00100000:0.0:1788330243.816706:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 397 00000100:00100000:0.0:1788330243.816714:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2410:x1875199766155136:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330243.816740:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2410:x1875199766155136:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 27us (3916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330243.816746:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 397 00000001:00100000:2.0:1788330243.999925:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00000001:00080000:2.0:1788330243.999950:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1788330243.999967:0:6501:0:(genops.c:885:class_export_put()) final put ffff99edc5f34800/f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00000020:00000080:0.0:1788330244.000189:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc5f34800/f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 for lustre-MDT0000 00000020:00000080:0.0:1788330244.000276:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc5c6a000 for lustre-MDT0000 00010000:00010000:3.0:1788330244.000615:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330245.019366:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330245.531440:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330245.531601:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330245.531623:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792420608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788330245.531696:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330245.531797:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792420608 00000100:00100000:3.0:1788330245.531804:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792420608 00000100:00100000:3.0:1788330245.531898:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788330245.531910:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792420608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788330245.531943:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788330245.531989:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792420608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330245.532016:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788330245.532073:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792420608:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788330245.532116:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330245.532312:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792420480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330245.532350:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330245.532896:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792420736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330245.532937:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330245.533030:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792420736 00000100:00100000:2.0:1788330245.533036:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792420736 00000100:00100000:2.0:1788330245.533079:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788330245.533175:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792420736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788330245.533204:0:6528:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788330245.533246:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792420736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 159us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330245.533252:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788330245.533326:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792420736:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330245.533393:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792420480 00000100:00100000:3.0:1788330245.533397:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792420480 00000100:00100000:3.0:1788330245.533446:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788330245.533453:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc72fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792420480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330245.533467:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788330245.533505:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc72fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792420480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330245.533511:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788330245.533541:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792420480:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788330245.533599:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788330246.047325:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330246.744354:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330246.744408:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330246.745075:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330246.759585:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330246.759633:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766155904 00000100:00100000:3.0:1788330246.759643:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766155904 00000100:00100000:3.0:1788330246.759712:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 260 00000100:00100000:3.0:1788330246.759723:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ef8caa6-b8a4-4292-af89-d5e39e506906+6:2409:x1875199766155904:12345-192.168.202.50@tcp:39:umount.0 00000020:00000080:3.0:1788330246.759765:0:12916:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0fb5 00000020:00010000:3.0:1788330246.759774:0:12916:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99edc75d6800: total 0 00000100:00080000:3.0:1788330246.759779:0:12916:0:(import.c:65:import_set_state_nolock()) ffff99edc75d6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788330246.759803:0:12916:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:3.0:1788330246.760009:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2409:x1875199766155904:12345-192.168.202.50@tcp:39:umount.0 Request processed in 286us (432us total) trans 4294967529 rc 0/0 00000100:00100000:3.0:1788330246.760036:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 260 00000020:00010000:3.0:1788330246.760081:0:6511:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99edc75d6800: total 0 00010000:00010000:3.0:1788330246.760085:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330246.760132:0:6511:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99edc75d6800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788330246.760490:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eecbb95d00) 00010000:00010000:3.0:1788330246.760495:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330246.760504:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee800/0x8475908e9fd1f75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061c2 expref: 4 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330246.760527:0:6511:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99edc75d6800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788330246.760543:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330246.760545:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330246.760547:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788330246.761006:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330246.761125:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766155392 00000100:00100000:2.0:1788330246.761135:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766155392 00000100:00100000:2.0:1788330246.761458:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766155520 00000100:00100000:2.0:1788330246.761463:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766155520 00000100:00100000:2.0:1788330246.761487:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766155648 00000100:00100000:2.0:1788330246.761501:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766155648 00000100:00100000:2.0:1788330246.761525:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:2.0:1788330246.761534:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec986a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa3490c8-da14-415b-81e3-af4ba0c476db+12:2411:x1875199766155392:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330246.761547:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330246.761562:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef59ca400/0x8475908e9fd0fa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d2a expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330246.761576:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330246.761625:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec986a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa3490c8-da14-415b-81e3-af4ba0c476db+11:2411:x1875199766155392:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 91us (17281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330246.761650:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:2.0:1788330246.761706:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:2.0:1788330246.761713:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa3490c8-da14-415b-81e3-af4ba0c476db+10:2411:x1875199766155520:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330246.761722:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330246.761732:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef6e79800/0x8475908e9fd0fa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d5b expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330246.761741:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330246.761759:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa3490c8-da14-415b-81e3-af4ba0c476db+9:2411:x1875199766155520:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 47us (17350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330246.761766:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:2.0:1788330246.761779:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:2.0:1788330246.761785:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa3490c8-da14-415b-81e3-af4ba0c476db+8:2413:x1875199766155648:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330246.761792:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330246.761801:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef59cba00/0x8475908e9fd1160 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105de7 expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330246.761809:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330246.761825:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa3490c8-da14-415b-81e3-af4ba0c476db+7:2413:x1875199766155648:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 41us (16753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330246.761831:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:3.0:1788330246.778499:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330246.780372:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766156032 00000100:00100000:2.0:1788330246.780390:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766156032 00000100:00100000:2.0:1788330246.780485:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 261 00000100:00100000:2.0:1788330246.780499:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+5:2409:x1875199766156032:12345-192.168.202.50@tcp:39:umount.0 00000020:00000080:2.0:1788330246.780563:0:6522:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0fbc 00000100:00080000:2.0:1788330246.780575:0:6522:0:(import.c:65:import_set_state_nolock()) ffff99edc75d1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788330246.780609:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:1.0:1788330246.781544:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330246.781996:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ef8caa6-b8a4-4292-af89-d5e39e506906+3:2409:x1875199766156032:12345-192.168.202.50@tcp:39:umount.0 Request processed in 1494us (3501us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788330246.782020:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 261 00000100:00080000:3.0:1788330246.782222:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788330246.842537:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330246.842632:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766156288 00000100:00100000:0.0:1788330246.842643:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766156288 00000100:00100000:0.0:1788330246.842707:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 403 00000100:00100000:0.0:1788330246.842717:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+7:2409:x1875199766156288:12345-192.168.202.50@tcp:251:umount.0 00000020:00000080:0.0:1788330246.842766:0:6515:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0e7a 00000020:00010000:0.0:1788330246.842775:0:6515:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99edc7703800: total 0 00000100:00080000:0.0:1788330246.842795:0:6515:0:(import.c:65:import_set_state_nolock()) ffff99edc7702800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788330246.842904:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa3490c8-da14-415b-81e3-af4ba0c476db+3:2409:x1875199766156288:12345-192.168.202.50@tcp:251:umount.0 Request processed in 188us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330246.842913:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 403 00000020:00010000:1.0:1788330246.845120:0:6510:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99edc7703800: total 0 00010000:00010000:1.0:1788330246.845487:0:6510:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99edc7703800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788330246.845531:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef59cb000/0x8475908e9fd0f53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6105d1c expref: 2 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330246.845550:0:6510:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99edc7703800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788330246.845558:0:6510:0:(genops.c:885:class_export_put()) final put ffff99edc7703800/aa3490c8-da14-415b-81e3-af4ba0c476db 00010000:00010000:1.0:1788330246.845573:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330246.845574:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330246.845576:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788330246.845633:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7703800/aa3490c8-da14-415b-81e3-af4ba0c476db for MGS 00000020:00000080:0.0:1788330246.845672:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc7702800 for MGS 00010000:00010000:2.0:1788330247.069295:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330247.069788:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330247.069814:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792420864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330247.070103:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330247.070250:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792420864 00000100:00100000:2.0:1788330247.070261:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792420864 00000100:00100000:2.0:1788330247.070338:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788330247.070350:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792420864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330247.070380:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330247.070429:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792420864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330247.070437:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:0.0:1788330247.072623:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330247.072712:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792420864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330247.073871:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330247.073902:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792420992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330247.073985:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330247.074559:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792420992 00000100:00100000:2.0:1788330247.074572:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792420992 00000100:00100000:2.0:1788330247.074656:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788330247.074667:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792420992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788330247.074694:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788330247.074759:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792420992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330247.074766:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788330247.074826:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792420992:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788330247.074985:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788330248.093348:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330248.096635:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792421120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330248.096718:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330248.097019:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792421120 00000100:00100000:3.0:1788330248.097028:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792421120 00000100:00100000:3.0:1788330248.097083:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788330248.097094:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792421120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788330248.097133:0:7831:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788330248.097202:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792421120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330248.097210:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788330248.097265:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792421120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330248.606495:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792421248:0@lo:400:kworker.0 00000100:00100000:3.0:1788330248.606570:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330248.606626:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792421760:0@lo:400:kworker.0 00000100:00100000:3.0:1788330248.606656:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330248.606676:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792422272:0@lo:400:kworker.0 00000100:00100000:3.0:1788330248.606695:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330248.606720:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788330248.606726:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792421376:0@lo:400:kworker.0 00000100:00100000:3.0:1788330248.606747:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330248.606766:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792421888:0@lo:400:kworker.0 00000100:00100000:3.0:1788330248.606786:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330248.606802:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792422400:0@lo:400:kworker.0 00000100:00100000:3.0:1788330248.606822:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330248.606864:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792421504:0@lo:400:kworker.0 00000100:00100000:3.0:1788330248.606889:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330248.606901:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792422016:0@lo:400:kworker.0 00000100:00100000:3.0:1788330248.606924:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330248.606945:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792422528:0@lo:400:kworker.0 00000100:00100000:3.0:1788330248.606964:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330248.606981:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788330248.606988:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792421632:0@lo:400:kworker.0 00000100:00100000:3.0:1788330248.607011:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330248.607141:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792421760 00000100:00100000:2.0:1788330248.607168:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792421760 00000100:00100000:2.0:1788330248.607219:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792422272 00000100:00100000:2.0:1788330248.607222:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792422272 00000100:00100000:2.0:1788330248.607237:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792421376 00000100:00100000:2.0:1788330248.607239:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792421376 00000100:00100000:2.0:1788330248.607250:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792421888 00000100:00100000:2.0:1788330248.607252:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792421888 00000100:00100000:2.0:1788330248.607263:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792422400 00000100:00100000:2.0:1788330248.607265:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792422400 00000100:00100000:2.0:1788330248.607276:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792421504 00000100:00100000:2.0:1788330248.607278:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792421504 00000100:00100000:2.0:1788330248.607292:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1788330248.607302:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792421760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330248.607358:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792421760:12345-0@lo:400:kworker.0 Request processed in 57us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.607365:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1788330248.607384:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1788330248.607390:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792422272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330248.607420:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792422272:12345-0@lo:400:kworker.0 Request processed in 30us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.607426:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1788330248.607439:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1788330248.607445:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792421376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330248.607472:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792421376:12345-0@lo:400:kworker.0 Request processed in 27us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.607477:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1788330248.607489:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1788330248.607495:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792421888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330248.607539:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792421888:12345-0@lo:400:kworker.0 Request processed in 44us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.607546:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1788330248.607558:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1788330248.607564:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792422400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330248.607592:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792422400:12345-0@lo:400:kworker.0 Request processed in 27us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.607598:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1788330248.607609:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1788330248.607615:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792421504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330248.607637:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792421504:12345-0@lo:400:kworker.0 Request processed in 23us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.607643:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1788330248.607662:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792422016 00000100:00100000:2.0:1788330248.607665:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792422016 00000100:00100000:2.0:1788330248.607689:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792422528 00000100:00100000:2.0:1788330248.607692:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792422528 00000100:00100000:2.0:1788330248.607708:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788330248.607715:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792422016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330248.607747:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792422016:12345-0@lo:400:kworker.0 Request processed in 32us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.607753:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788330248.607763:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788330248.607769:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792422528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330248.607793:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792422528:12345-0@lo:400:kworker.0 Request processed in 25us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.607807:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:2.0:1788330248.607839:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330248.607845:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788330248.607847:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330248.607881:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792421376:0@lo:400:kworker.0 00010000:00080000:2.0:1788330248.607896:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc5eeaa00 x1875199792421888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330248.607907:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792421888:0@lo:400:kworker.0 00010000:00080000:2.0:1788330248.607918:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7798380 x1875199792422400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330248.607926:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792422400:0@lo:400:kworker.0 00000100:00100000:2.0:1788330248.607937:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792421760:0@lo:400:kworker.0 00000100:00100000:2.0:1788330248.607947:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792422272:0@lo:400:kworker.0 00000100:00100000:3.0:1788330248.608226:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792422144:0@lo:400:kworker.0 00000100:00100000:3.0:1788330248.608264:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330248.608283:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792422656:0@lo:400:kworker.0 00000100:00100000:3.0:1788330248.608304:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330248.608329:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792421504:0@lo:400:kworker.0 00000100:00100000:3.0:1788330248.608339:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792422016:0@lo:400:kworker.0 00000100:00100000:3.0:1788330248.608348:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792422528:0@lo:400:kworker.0 00000100:00100000:3.0:1788330248.608378:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792421248 00000100:00100000:3.0:1788330248.608382:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792421248 00000100:00100000:3.0:1788330248.608411:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1788330248.608418:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3646:x1875199792421248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330248.608463:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3646:x1875199792421248:12345-0@lo:400:kworker.0 Request processed in 45us (1892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330248.608468:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1788330248.609364:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792421248:0@lo:400:kworker.0 00000100:00100000:0.0:1788330248.610440:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792422144 00000100:00100000:0.0:1788330248.610449:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792422144 00000100:00100000:0.0:1788330248.610558:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792422656 00000100:00100000:0.0:1788330248.610563:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792422656 00000100:00100000:0.0:1788330248.610623:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788330248.610632:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792422144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330248.610902:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792422144:12345-0@lo:400:kworker.0 Request processed in 270us (2636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330248.610934:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788330248.610965:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788330248.610973:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792422656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330248.611056:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792422656:12345-0@lo:400:kworker.0 Request processed in 59us (2725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330248.611063:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788330248.611236:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792422144:0@lo:400:kworker.0 00000100:00100000:0.0:1788330248.611252:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792422656:0@lo:400:kworker.0 00000100:00100000:0.0:1788330248.611339:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792421632 00000100:00100000:0.0:1788330248.611356:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792421632 00000100:00100000:0.0:1788330248.611403:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788330248.611424:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792421632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330248.611504:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792421632:12345-0@lo:400:kworker.0 Request processed in 82us (4480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330248.611512:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788330248.611578:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792421632:0@lo:400:kworker.0 00000100:00080000:2.0:1788330248.613947:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1788330248.670800:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788330248.923773:0:13809:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788330248.923788:0:13809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788330248.925532:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1788330248.925560:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:01000004:0.0:1788330248.942583:0:15114:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788330248.951321:0:15114:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788330248.951390:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cac00/0x8475908e9fd0f22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f29 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.951406:0:15114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cac00/0x8475908e9fd0f22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0f29 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.951415:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cac00/0x8475908e9fd0f22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0f29 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.951424:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eef59cac00/0x8475908e9fd0f22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0f29 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.951454:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788330248.951460:0:15114:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788330248.951486:0:15114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788330248.951508:0:15114:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788330248.951514:0:15114:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788330248.951539:0:15114:0:(import.c:65:import_set_state_nolock()) ffff99eedfe4f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788330248.951576:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875199792422784:0@lo:39:umount.0 00010000:00010000:3.0:1788330248.951614:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330248.951630:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef59cac00/0x8475908e9fd0f22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0f29 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.951643:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cac00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330248.951654:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef59cac00/0x8475908e9fd0f22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0f29 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.951667:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef59cac00/0x8475908e9fd0f22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd0f29 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330248.951694:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef59cac00/0x8475908e9fd0f22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd0f29 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330248.951701:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788330248.951704:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788330248.951708:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788330248.951763:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef59cac00/0x8475908e9fd0f22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd0f29 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.951771:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330248.951812:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef59cac00/0x8475908e9fd0f22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd0f29 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.951819:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef59cac00/0x8475908e9fd0f22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd0f29 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.951846:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330248.951848:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330248.951851:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330248.951871:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788330248.951882:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330248.952027:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792422912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330248.952084:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330248.952175:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792422912 00000100:00100000:0.0:1788330248.952185:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792422912 00000100:00100000:0.0:1788330248.952370:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788330248.952382:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792422912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330248.952397:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330248.952418:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c3600/0x8475908e9fd0f29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd0f22 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.952433:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330248.952481:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:3647:x1875199792422912:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330248.952488:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788330248.952560:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792422784 00000100:00100000:2.0:1788330248.952565:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792422784 00000100:00100000:2.0:1788330248.952598:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788330248.952604:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875199792422784:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788330248.952625:0:6522:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0a91 00000100:00080000:2.0:1788330248.952634:0:6522:0:(import.c:65:import_set_state_nolock()) ffff99eef590c800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788330248.952687:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3645:x1875199792422784:12345-0@lo:39:umount.0 Request processed in 84us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.952706:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:2.0:1788330248.952713:0:6522:0:(genops.c:885:class_export_put()) final put ffff99eef590b000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788330248.952739:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788330248.952749:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef590b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788330248.952793:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eef590c800 for lustre-MDT0000 00000100:00080000:2.0:1788330248.952844:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eedfe4f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788330248.952855:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875199792422784:0@lo:39:umount.0 00000100:00080000:0.0:1788330248.956186:0:15114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788330248.956195:0:15114:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788330248.956201:0:15114:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788330248.956236:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792422912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330248.957059:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765ac00/0x8475908e9fd0f30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f37 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.957075:0:15114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765ac00/0x8475908e9fd0f30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0f37 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.957083:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765ac00/0x8475908e9fd0f30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0f37 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.957114:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99edc765ac00/0x8475908e9fd0f30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0f37 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.957143:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788330248.957187:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330248.957188:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd0e34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0e3b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.957196:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99edc765ac00/0x8475908e9fd0f30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0f37 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.957196:0:15114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd0e34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0e3b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.957203:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd0e34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0e3b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.957204:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765ac00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:1.0:1788330248.957210:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99edc765ac00/0x8475908e9fd0f30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0f37 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.957210:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd0e34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0e3b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.957219:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99edc765ac00/0x8475908e9fd0f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd0f37 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.957221:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330248.957227:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765a400/0x8475908e9fd1198 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd119f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788330248.957235:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99edc765ac00/0x8475908e9fd0f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd0f37 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330248.957242:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788330248.957245:0:10341:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788330248.957282:0:10341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99edc765ac00/0x8475908e9fd0f30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd0f37 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.957289:0:10341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788330248.957315:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99edc765ac00/0x8475908e9fd0f30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd0f37 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.957322:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99edc765ac00/0x8475908e9fd0f30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd0f37 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.957336:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330248.957340:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd0e34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0e3b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.957345:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99ef02065600 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:1.0:1788330248.957347:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd0e34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0e3b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.957353:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd0e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd0e3b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788330248.957359:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd0e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd0e3b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330248.957363:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788330248.957370:0:10341:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788330248.957373:0:10341:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788330248.957389:0:10341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd0e34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd0e3b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.957394:0:10341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788330248.957410:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd0e34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd0e3b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.957416:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99ef02065600/0x8475908e9fd0e34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd0e3b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330248.957739:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330248.957760:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792423040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330248.957841:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330248.957907:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792423040 00000100:00100000:2.0:1788330248.957915:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792423040 00000100:00100000:2.0:1788330248.957967:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788330248.957980:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8452300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+23:3646:x1875199792423040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330248.957994:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330248.958009:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef6e78400/0x8475908e9fd0f37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd0f30 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.958023:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330248.958058:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8452300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:3646:x1875199792423040:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.958065:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788330248.958103:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792423040:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330248.958238:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330248.958381:0:15114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765a400/0x8475908e9fd1198 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd119f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.958388:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765a400/0x8475908e9fd1198 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd119f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.958394:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99edc765a400/0x8475908e9fd1198 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd119f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.958421:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330248.958424:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99edc765a400/0x8475908e9fd1198 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd119f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.958430:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765a400 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:1.0:1788330248.958433:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99edc765a400/0x8475908e9fd1198 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd119f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.958435:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788330248.958441:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99edc765a400/0x8475908e9fd1198 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd119f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.958442:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec0030e00/0x8475908e9fd09f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd09f7 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788330248.958448:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99edc765a400/0x8475908e9fd1198 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd119f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.958449:0:15114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec0030e00/0x8475908e9fd09f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd09f7 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330248.958455:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788330248.958456:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec0030e00/0x8475908e9fd09f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd09f7 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330248.958458:0:10341:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788330248.958460:0:10341:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788330248.958461:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eec0030e00/0x8475908e9fd09f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd09f7 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.958469:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788330248.958472:0:15114:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788330248.958474:0:15114:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788330248.958475:0:10341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99edc765a400/0x8475908e9fd1198 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd119f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.958489:0:10341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788330248.958498:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99edc765a400/0x8475908e9fd1198 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd119f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.958503:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99edc765a400/0x8475908e9fd1198 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd119f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788330248.958506:0:15114:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788330248.958510:0:15114:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:1.0:1788330248.958512:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330248.958514:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec0030e00/0x8475908e9fd09f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd09f7 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788330248.958514:0:15114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788330248.958519:0:15114:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/11 00010000:00010000:1.0:1788330248.958520:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec0030e00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:1.0:1788330248.958522:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec0030e00/0x8475908e9fd09f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd09f7 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788330248.958524:0:15114:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99edc67ed800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1788330248.958529:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec0030e00/0x8475908e9fd09f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd09f7 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788330248.958530:0:15114:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99edc5f37800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:1.0:1788330248.958536:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec0030e00/0x8475908e9fd09f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd09f7 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788330248.958536:0:15114:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99eef5b48000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788330248.958540:0:15114:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99eee757d800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 10000000:01000000:1.0:1788330248.958542:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788330248.958544:0:10341:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788330248.958545:0:10341:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00080000:0.0:1788330248.958548:0:15114:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff99edc75d6800 7ef8caa6-b8a4-4292-af89-d5e39e506906 192.168.202.50@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788330248.958553:0:15114:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff99eee764b370) has exports, disconnecting them 00010000:00010000:1.0:1788330248.958555:0:10341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec0030e00/0x8475908e9fd09f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd09f7 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.958560:0:10341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1788330248.958562:0:15114:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99edc67ed800), last request at 1788330248 00000020:00000080:0.0:1788330248.958569:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0da1 00010000:00010000:1.0:1788330248.958576:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec0030e00/0x8475908e9fd09f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd09f7 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788330248.958584:0:15114:0:(import.c:65:import_set_state_nolock()) ffff99edc67ec800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788330248.958591:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec0030e00/0x8475908e9fd09f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd09f7 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.958600:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330248.958601:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330248.958603:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330248.958610:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330248.958619:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792423424:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788330248.958628:0:15114:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99edc67ed800): rc 0 00000020:00000080:0.0:1788330248.958630:0:15114:0:(genops.c:885:class_export_put()) final put ffff99edc67ed800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788330248.958640:0:15114:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99edc5f37800), last request at 1788330248 00000020:00000080:0.0:1788330248.958643:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0c7b 00000100:00080000:0.0:1788330248.958649:0:15114:0:(import.c:65:import_set_state_nolock()) ffff99eef59fd800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788330248.958653:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788330248.958659:0:15114:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99edc5f37800): rc 0 00000020:00000080:0.0:1788330248.958661:0:15114:0:(genops.c:885:class_export_put()) final put ffff99edc5f37800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788330248.958665:0:15114:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99eef5b48000), last request at 1788329996 00000020:00000080:0.0:1788330248.958668:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0b78 00000100:00080000:0.0:1788330248.958672:0:15114:0:(import.c:65:import_set_state_nolock()) ffff99eef5b49000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788330248.958677:0:15114:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99eef5b48000): rc 0 00000020:00000080:0.0:1788330248.958679:0:15114:0:(genops.c:885:class_export_put()) final put ffff99eef5b48000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788330248.958683:0:15114:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99eee757d800), last request at 1788329996 00000100:00100000:1.0:1788330248.958684:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792423168:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1788330248.958685:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0b39 00000100:00080000:0.0:1788330248.958689:0:15114:0:(import.c:65:import_set_state_nolock()) ffff99eee757d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788330248.958694:0:15114:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00100000:1.0:1788330248.958706:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330248.958724:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788330248.958728:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792423296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330248.958748:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788330248.958774:0:15114:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99eee757d800): rc 0 00000004:00000080:0.0:1788330248.958781:0:15114:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb7bcc1473ae0 00000100:00080000:0.0:1788330248.958800:0:15114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788330248.958803:0:15114:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000020:00000080:2.0:1788330248.959378:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc67ed800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788330248.959419:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc5f37800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788330248.959440:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef5b48000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788330248.959479:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc67ec800 for lustre-MDT0000 00000020:00000080:2.0:1788330248.959484:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eef59fd800 for lustre-MDT0000 00000020:00000080:2.0:1788330248.959487:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eef5b49000 for lustre-MDT0000 00000100:00100000:1.0:1788330248.959538:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792423424 00000100:00100000:1.0:1788330248.959545:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792423424 00000100:00100000:1.0:1788330248.959587:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792423168 00000100:00100000:2.0:1788330248.959589:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792423296 00000100:00100000:1.0:1788330248.959591:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792423168 00000100:00100000:2.0:1788330248.959592:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792423296 00000100:00100000:2.0:1788330248.959611:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788330248.959673:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330248.959679:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330248.959718:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788330248.959723:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3647:x1875199792423424:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330248.959724:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+24:3648:x1875199792423168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330248.959734:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330248.959734:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330248.959749:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ef02065e00/0x8475908e9fd09f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd09f0 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.959749:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99ef02064200/0x8475908e9fd0e3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd0e34 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.959762:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788330248.959841:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330248.959861:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:3647:x1875199792423424:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.959869:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788330248.959871:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+22:3648:x1875199792423168:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.959885:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788330248.960370:0:15114:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788330248.960396:0:15114:0:(import.c:65:import_set_state_nolock()) ffff99eef59f8000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788330248.960462:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330248.960494:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792423168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330248.960599:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788330248.960651:0:15114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788330248.960662:0:15114:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:0.0:1788330248.960676:0:15114:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788330248.960734:0:15114:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788330248.960746:0:15114:0:(import.c:65:import_set_state_nolock()) ffff99edc6559800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788330248.960751:0:15114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788330248.960753:0:15114:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 3 00000004:00080000:0.0:1788330248.960770:0:15114:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788330248.960894:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec986b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+21:3648:x1875199792423296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330248.960907:0:8454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330248.960922:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99edc765b400/0x8475908e9fd119f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd1198 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.960933:0:8454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330248.960984:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec986b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:3648:x1875199792423296:12345-0@lo:103:ldlm_bl.0 Request processed in 1092us (2234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.960991:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788330248.961050:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792423552:0@lo:39:umount.0 00000100:00100000:2.0:1788330248.961085:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330248.961107:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792423680:0@lo:9:umount.0 00000100:00100000:1.0:1788330248.961126:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792423296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330248.961140:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330248.961176:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792423680 00000100:00100000:1.0:1788330248.961182:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792423680 00000100:00100000:2.0:1788330248.961186:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792423552 00000100:00100000:2.0:1788330248.961188:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792423552 00000100:00100000:2.0:1788330248.961215:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788330248.961215:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788330248.961223:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875199792423552:12345-0@lo:39:umount.0 00000100:00100000:1.0:1788330248.961223:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875199792423680:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788330248.961244:0:6528:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0bd3 00000020:00000080:1.0:1788330248.961245:0:8439:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0d23 00000100:00080000:2.0:1788330248.961253:0:6528:0:(import.c:65:import_set_state_nolock()) ffff99eef6d1c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788330248.961275:0:6528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:1.0:1788330248.961361:0:8439:0:(import.c:65:import_set_state_nolock()) ffff99eedfe6d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788330248.961399:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788330248.961409:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3645:x1875199792423552:12345-0@lo:39:umount.0 Request processed in 186us (323us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788330248.961415:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788330248.961487:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3645:x1875199792423680:12345-0@lo:9:umount.0 Request processed in 264us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330248.961494:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:2.0:1788330248.961637:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788330248.961660:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eef59f8000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788330248.961667:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792423552:0@lo:39:umount.0 00000100:00080000:2.0:1788330248.961676:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc6559800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788330248.961684:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788330248.961685:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788330248.961688:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792423680:0@lo:9:umount.0 00010000:00010000:1.0:1788330248.962123:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788330248.964436:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788330248.964446:0:8433:0:(genops.c:885:class_export_put()) final put ffff99eedfe6b000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788330248.964474:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00000020:00000080:1.0:1788330248.964476:0:8433:0:(genops.c:885:class_export_put()) final put ffff99edc7c0a000/f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00000100:00080000:0.0:1788330248.965275:0:15114:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788330248.965312:0:15114:0:(import.c:65:import_set_state_nolock()) ffff99edc759d800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788330248.965375:0:15114:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff99eee764b370) has no exports 00000020:00000080:2.0:1788330248.965578:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedfe6b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788330248.965625:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7c0a000/f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 for lustre-OST0000 00000020:00000080:2.0:1788330248.965648:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eedfe6d000 for lustre-OST0000 00000020:00000080:2.0:1788330248.965653:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc7c0b000 for lustre-OST0000 00000100:00100000:2.0:1788330248.965676:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792423808:0@lo:9:umount.0 00000100:00100000:2.0:1788330248.965752:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330248.966463:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3647:1875199792423424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330248.968843:0:8632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792423808 00000100:00100000:1.0:1788330248.968857:0:8632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792423808 00000100:00100000:1.0:1788330248.969070:0:8632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788330248.969084:0:8632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875199792423808:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788330248.969117:0:8632:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0e73 00000100:00080000:1.0:1788330248.969128:0:8632:0:(import.c:65:import_set_state_nolock()) ffff99edc7703000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788330248.969183:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1788330248.969200:0:8632:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:1.0:1788330248.969403:0:8632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3645:x1875199792423808:12345-0@lo:9:umount.0 Request processed in 321us (3648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330248.969420:0:8632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000001:00100000:3.0:1788330248.970429:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788330248.970441:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1788330248.970446:0:7454:0:(genops.c:885:class_export_put()) final put ffff99eef59f9000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788330248.970469:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7ef8caa6-b8a4-4292-af89-d5e39e506906 00000001:00080000:3.0:1788330248.970474:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1788330248.970476:0:7454:0:(genops.c:885:class_export_put()) final put ffff99edc75d3800/7ef8caa6-b8a4-4292-af89-d5e39e506906 00000001:00100000:3.0:1788330248.970482:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00000001:00080000:3.0:1788330248.970485:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1788330248.970487:0:7454:0:(genops.c:885:class_export_put()) final put ffff99eeffced000/f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00000020:00000080:0.0:1788330248.970658:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef59f9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00100000:3.0:1788330248.970664:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788330248.970667:0:9518:0:(genops.c:885:class_export_put()) final put ffff99edc7707000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788330248.970686:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00000020:00000080:3.0:1788330248.970689:0:9518:0:(genops.c:885:class_export_put()) final put ffff99eec865c800/f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 00000020:00000080:0.0:1788330248.970716:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc75d3800/7ef8caa6-b8a4-4292-af89-d5e39e506906 for lustre-MDT0001 00000020:00000080:0.0:1788330248.970739:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99eeffced000/f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 for lustre-MDT0001 00000020:00000080:0.0:1788330248.970763:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eef6d1c000 for lustre-MDT0001 00000020:00000080:0.0:1788330248.970768:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7707000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788330248.970784:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99eec865c800/f20f0234-bf39-4a7d-aca3-cb4a22d2dbf3 for lustre-OST0001 00000020:00000080:0.0:1788330248.970806:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc75d1000 for lustre-MDT0001 00000020:00000080:0.0:1788330248.970809:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eeffce8000 for lustre-MDT0001 00000020:00000080:0.0:1788330248.970814:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc7703000 for lustre-OST0001 00000020:00000080:0.0:1788330248.970817:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eec8659000 for lustre-OST0001 00000100:00080000:2.0:1788330248.971115:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc759d800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788330248.971129:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788330248.971143:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788330248.971170:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792423808:0@lo:9:umount.0 00000020:00080000:0.0:1788330248.977345:0:15114:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff99eee764b370) has no exports 00000020:00000080:0.0:1788330249.058928:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0a4b 00000020:00000080:0.0:1788330249.058959:0:15114:0:(genops.c:885:class_export_put()) final put ffff99eefd33a000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788330249.058990:0:15114:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788330249.059144:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eefd33a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788330249.059218:0:15114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788330249.059233:0:15114:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788330249.059247:0:15114:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff99eefd334d28) has no exports 00000020:00000080:1.0:1788330249.059923:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0a44 00000020:00000080:1.0:1788330249.059933:0:15114:0:(genops.c:885:class_export_put()) final put ffff99eedfe19000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788330249.060036:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedfe19000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788330249.060972:0:15114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788330249.060989:0:15114:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788330249.060996:0:15114:0:(genops.c:885:class_export_put()) final put ffff99eedfe18000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788330249.060999:0:15114:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedfe18000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788330249.061007:0:15114:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1788330249.117326:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330250.140118:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330250.651791:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792423936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788330250.651907:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330250.652383:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792423936 00000100:00100000:0.0:1788330250.652395:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792423936 00000100:00100000:0.0:1788330250.653816:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788330250.653835:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792423936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788330250.653902:0:8441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788330250.654034:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792423936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 206us (2126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330250.654042:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788330250.654268:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792423936:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788330250.656776:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788330251.163642:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330252.188396:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330252.188564:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792424064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330252.188677:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330252.188918:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792424064 00000100:00100000:3.0:1788330252.188931:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792424064 00000100:00080000:0.0:1788330252.189200:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330252.189403:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788330252.189420:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792424064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788330252.189472:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788330252.189560:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792424064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 144us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330252.189568:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788330252.189670:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792424064:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788330253.213219:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330253.213419:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788330253.213450:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792424192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330253.213573:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330253.213771:0:7831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792424192 00000100:00100000:0.0:1788330253.213817:0:7831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792424192 00000100:00100000:0.0:1788330253.213880:0:7831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788330253.213891:0:7831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1875199792424192:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1788330253.213901:0:7831:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788330253.213969:0:7831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3648:x1875199792424192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (396us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788330253.213978:0:7831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:02020000:1.0:1788330253.214991:0:3648:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000001:00100000:3.0:1788330253.217445:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788330253.217457:0:6501:0:(genops.c:885:class_export_put()) final put ffff99eee757d800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788330253.217629:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7ef8caa6-b8a4-4292-af89-d5e39e506906 00000001:00080000:3.0:1788330253.217638:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:3.0:1788330253.217642:0:6501:0:(genops.c:885:class_export_put()) final put ffff99edc75d6800/7ef8caa6-b8a4-4292-af89-d5e39e506906 00000020:00000080:2.0:1788330253.221564:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99eee757d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788330253.221699:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eee757d000 for lustre-MDT0000 00000100:00080000:1.0:1788330253.223600:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788330253.223609:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99eefe46b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788330253.223614:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000020:00000080:2.0:1788330253.226198:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc75d6800/7ef8caa6-b8a4-4292-af89-d5e39e506906 for lustre-MDT0000 00000020:00000080:2.0:1788330253.226279:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc75d6000 for lustre-MDT0000 00000100:00080000:1.0:1788330253.239243:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99eefe46b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330253.239258:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 200 00000100:00080000:1.0:1788330253.239291:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99eefe46b000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330253.239381:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7e76680 x1875199792424320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788330253.239571:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792424320:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788330253.239668:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330253.239850:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792424320 00000100:00100000:0.0:1788330253.239860:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792424320 00000100:00100000:0.0:1788330253.239904:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788330253.239912:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875199792424320:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1788330253.239929:0:6527:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788330253.242643:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875199792424320:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 2722us (2973us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788330253.242658:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:1.0:1788330253.243243:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eefe46b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330253.243250:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788330253.243255:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792424320:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788330253.723561:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792424704:0@lo:400:kworker.0 00000100:00100000:3.0:1788330253.723651:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330253.723734:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792425216:0@lo:400:kworker.0 00000100:00100000:3.0:1788330253.723768:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330253.723820:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792424704 00000100:00100000:3.0:1788330253.723828:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792424704 00000100:00100000:3.0:1788330253.723869:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792425216 00000100:00100000:3.0:1788330253.723872:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792425216 00000100:00100000:3.0:1788330253.723907:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1788330253.723923:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792425216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330253.723971:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792425216:12345-0@lo:400:kworker.0 Request processed in 51us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330253.723978:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1788330253.723993:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788330253.723997:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875199792424704:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788330253.724003:0:6523:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788330253.724026:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875199792424704:12345-0@lo:400:kworker.0 Request processed in 28us (376us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788330253.724032:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:3.0:1788330253.724053:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788330253.724088:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefd32ed80 x1875199792425216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330253.724127:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792425216:0@lo:400:kworker.0 00000100:00080000:3.0:1788330253.724184:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788330253.724189:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99edc5f37000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788330253.724193:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788330253.727391:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792424448:0@lo:400:kworker.0 00000100:00100000:2.0:1788330253.727497:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330253.727563:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792424960:0@lo:400:kworker.0 00000100:00100000:2.0:1788330253.727592:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330253.727621:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788330253.727628:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792424576:0@lo:400:kworker.0 00000100:00100000:2.0:1788330253.727651:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330253.727673:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792425088:0@lo:400:kworker.0 00000100:00100000:2.0:1788330253.727692:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330253.727726:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792424576 00000100:00100000:2.0:1788330253.727733:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792424576 00000100:00100000:2.0:1788330253.727790:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792425088 00000100:00100000:2.0:1788330253.727794:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792425088 00000100:00100000:2.0:1788330253.727816:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788330253.727825:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875199792424576:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788330253.727834:0:7832:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788330253.727879:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875199792424576:12345-0@lo:400:kworker.0 Request processed in 53us (226us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788330253.727908:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788330253.727927:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788330253.727931:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875199792425088:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788330253.727935:0:7832:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788330253.727958:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875199792425088:12345-0@lo:400:kworker.0 Request processed in 26us (266us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788330253.727964:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788330253.727992:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792424832:0@lo:400:kworker.0 00000100:00100000:2.0:1788330253.728018:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330253.728035:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792425344:0@lo:400:kworker.0 00000100:00100000:2.0:1788330253.728055:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330253.728085:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792424960 00000100:00100000:2.0:1788330253.728089:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792424960 00000100:00100000:2.0:1788330253.728120:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792425344 00000100:00100000:2.0:1788330253.728122:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792425344 00000100:00100000:2.0:1788330253.728204:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788330253.728211:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8453b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792424960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330253.728253:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8453b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792424960:12345-0@lo:400:kworker.0 Request processed in 43us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330253.728258:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788330253.728270:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788330253.728276:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792425344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330253.728304:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792425344:12345-0@lo:400:kworker.0 Request processed in 29us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330253.728309:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788330253.728340:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792425344:0@lo:400:kworker.0 00000100:00100000:2.0:1788330253.728371:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792424832 00000100:00100000:2.0:1788330253.728374:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792424832 00000100:00100000:2.0:1788330253.728400:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1788330253.728406:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792424832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330253.728441:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792424832:12345-0@lo:400:kworker.0 Request processed in 35us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330253.728448:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00010000:00080000:2.0:1788330253.728472:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eefd32fb80 x1875199792424832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330253.728482:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792424832:0@lo:400:kworker.0 00000100:00080000:2.0:1788330253.728504:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788330253.728509:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99eefe444800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788330253.728512:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788330253.728518:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99eefe444800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330253.728521:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 200 00000100:00080000:2.0:1788330253.728527:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99eefe444800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330253.728552:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc8452680 x1875199792425472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788330253.728570:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792424576:0@lo:400:kworker.0 00000100:00080000:2.0:1788330253.728580:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788330253.728582:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99edc5f36000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788330253.728585:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788330253.728588:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99edc5f36000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330253.728598:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 245 00000100:00080000:2.0:1788330253.728602:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99edc5f36000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330253.728615:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc8451500 x1875199792425600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788330253.728624:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792425088:0@lo:400:kworker.0 00000100:00100000:2.0:1788330253.728636:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792424960:0@lo:400:kworker.0 00000100:00080000:2.0:1788330253.728669:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788330253.728674:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330253.728806:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792424448 00000100:00100000:0.0:1788330253.728811:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792424448 00000100:00100000:0.0:1788330253.728845:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1788330253.728851:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec98f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:3646:x1875199792424448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330253.728890:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec98f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf+19:3646:x1875199792424448:12345-0@lo:400:kworker.0 Request processed in 39us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330253.728903:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1788330253.728941:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792424448:0@lo:400:kworker.0 00000100:00100000:1.0:1788330253.729081:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875199792425472:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788330253.729110:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330253.729138:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875199792425600:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788330253.729186:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330253.729209:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792425472 00000100:00100000:1.0:1788330253.729212:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792425472 00000100:00100000:1.0:1788330253.729229:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792425600 00000100:00100000:1.0:1788330253.729231:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792425600 00000100:00100000:1.0:1788330253.729242:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788330253.729246:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875199792425472:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1788330253.729260:0:6524:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788330253.729286:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875199792425472:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 38us (175us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788330253.729292:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788330253.729302:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788330253.729305:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875199792425600:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1788330253.729311:0:6524:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788330253.729328:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875199792425600:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 21us (142us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788330253.729333:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1788330253.729359:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eefe444800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330253.729363:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788330253.729366:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875199792425472:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788330253.729373:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc5f36000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330253.729375:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788330253.729378:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875199792425600:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1788330253.746589:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99edc5f37000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788330253.746606:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 222 00000100:00080000:3.0:1788330253.746620:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99edc5f37000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330253.748284:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eeffd6b480 x1875199792425728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788330253.748327:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792424704:0@lo:400:kworker.0 00000100:00100000:1.0:1788330253.748520:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875199792425728:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788330253.748598:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330253.748709:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792425728 00000100:00100000:0.0:1788330253.748717:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792425728 00000100:00100000:0.0:1788330253.748761:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788330253.748769:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1875199792425728:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1788330253.748796:0:12916:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788330253.756655:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1875199792425728:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 7872us (8043us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788330253.756686:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1788330253.756840:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc5f37000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330253.756846:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788330253.756851:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875199792425728:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1788330254.237167:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788330255.131339:0:15114:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99eef6e53c60 - data ffff99eedfab5798/ffff99edc76a5c00 00000020:01000000:1.0:1788330255.131529:0:15114:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99eed0b1b6c0 - data ffff99eedf971438/ffff99eef5685000 00000001:00000004:1.0:1788330255.141463:0:15114:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:2.0:1788330255.205221:0:15114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788330255.205230:0:15114:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788330255.205246:0:15114:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99eeffcfbb80 x1875199792423552/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788330258 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330255.205274:0:15114:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788330255.212066:0:15114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788330255.212076:0:15114:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1788330255.212098:0:15114:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788330255.212101:0:15114:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788330255.212329:0:8630:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788330255.212334:0:8630:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1788330255.212366:0:8630:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788330255.215108:0:15114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788330255.215121:0:15114:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 4 00000004:00080000:2.0:1788330255.215716:0:15114:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788330255.215720:0:15114:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788330255.217059:0:9990:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788330255.217067:0:9990:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1788330255.217081:0:9990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788330255.221663:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0a13 00000020:00000080:2.0:1788330255.221675:0:15114:0:(genops.c:885:class_export_put()) final put ffff99eedfe4c000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788330255.222554:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedfe4c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788330255.233564:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0a28 00000020:00000080:2.0:1788330255.233581:0:15114:0:(genops.c:885:class_export_put()) final put ffff99eedfe6f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788330255.233618:0:15114:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788330255.233623:0:15114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330255.233634:0:15114:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788330255.233639:0:15114:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff99eee7648000) has no exports 00000020:00000080:0.0:1788330255.233883:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedfe6f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1788330255.233971:0:15114:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788330255.233979:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0e5e 00000020:00000080:2.0:1788330255.233985:0:15114:0:(genops.c:885:class_export_put()) final put ffff99edc7700000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788330255.233999:0:15114:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788330255.234003:0:15114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330255.234013:0:15114:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788330255.234015:0:15114:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff99eeffc4b370) has no exports 00000020:00000080:2.0:1788330255.234022:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0e57 00000020:00000080:2.0:1788330255.234025:0:15114:0:(genops.c:885:class_export_put()) final put ffff99edc759c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788330255.234571:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc7700000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788330255.234580:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc759c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788330255.234637:0:15114:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788330255.234641:0:15114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788330255.234646:0:15114:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 5 00000004:00080000:2.0:1788330255.234652:0:15114:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788330255.234654:0:15114:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788330255.234730:0:15114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788330255.234739:0:15114:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788330255.234744:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0d1c 00000020:00000080:2.0:1788330255.234749:0:15114:0:(genops.c:885:class_export_put()) final put ffff99edc5f33000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788330255.240746:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc759d800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788330255.240778:0:36:0:(genops.c:885:class_export_put()) final put ffff99edc759f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788330255.240781:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc759f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788330255.240789:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788330255.245337:0:15114:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788330255.246896:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc5f33000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788330255.247308:0:15114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330255.247326:0:15114:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788330255.247333:0:15114:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff99eeffc499b8) has no exports 00000020:00000080:2.0:1788330255.247343:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0d15 00000020:00000080:2.0:1788330255.247352:0:15114:0:(genops.c:885:class_export_put()) final put ffff99edc6559000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788330255.247827:0:15114:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788330255.247833:0:15114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788330255.247839:0:15114:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1788330255.247844:0:15114:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788330255.247864:0:15114:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788330255.247908:0:15114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788330255.247919:0:15114:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788330255.247936:0:15114:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788330255.247944:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0bcc 00000020:00000080:2.0:1788330255.247949:0:15114:0:(genops.c:885:class_export_put()) final put ffff99eefe765800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788330255.247954:0:15114:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788330255.247959:0:15114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330255.247963:0:15114:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788330255.247965:0:15114:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff99eee76c0000) has no exports 00000020:00000080:2.0:1788330255.247969:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0bc5 00000020:00000080:2.0:1788330255.247972:0:15114:0:(genops.c:885:class_export_put()) final put ffff99eef59ff800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788330255.248920:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc6559000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788330255.248933:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc6559800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788330255.248943:0:36:0:(genops.c:885:class_export_put()) final put ffff99edc655f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788330255.248945:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc655f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788330255.248950:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788330255.249039:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eefe765800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788330255.249044:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef59ff800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788330255.263612:0:15114:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788330255.263633:0:15114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788330255.263638:0:15114:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1788330255.263649:0:15114:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788330255.263705:0:15114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330255.263725:0:15114:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788330255.263774:0:15114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330255.263777:0:15114:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788330255.263785:0:15114:0:(genops.c:885:class_export_put()) final put ffff99eedfe4b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788330255.263791:0:15114:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedfe4b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788330255.263808:0:15114:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788330255.263954:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0a2f 00000020:00000080:3.0:1788330255.263975:0:15114:0:(genops.c:885:class_export_put()) final put ffff99eedfe68000/lustre-MDD0000_UUID 00000020:01000000:3.0:1788330255.263981:0:15114:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788330255.263985:0:15114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788330255.263990:0:15114:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788330255.263994:0:15114:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff99eee76499b8) has no exports 00000020:00000080:3.0:1788330255.264029:0:15114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330255.264033:0:15114:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788330255.264036:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0a36 00000020:00000080:3.0:1788330255.264040:0:15114:0:(genops.c:885:class_export_put()) final put ffff99eedfe6f800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788330255.264049:0:15114:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99eec865b000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788330255.264053:0:15114:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eec865b000 3 00000020:01000004:3.0:1788330255.264056:0:15114:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99eec865b000 from lustre-MDT0000 00000020:00000080:3.0:1788330255.264076:0:15114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330255.264080:0:15114:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788330255.264082:0:15114:0:(genops.c:885:class_export_put()) final put ffff99eedfe48800/lustre-MDT0000_UUID 00000020:00000080:3.0:1788330255.264085:0:15114:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedfe48800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788330255.264093:0:15114:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788330255.264123:0:15114:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1788330255.264126:0:15114:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788330255.264129:0:15114:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788330255.264131:0:15114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788330255.264133:0:15114:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788330255.264141:0:15114:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff99eec9884800 cfe8163f-ff22-4eb0-b728-b3e96f32c3cf 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788330255.264146:0:15114:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff99eee76c4d28) has exports, disconnecting them 00000020:00080000:3.0:1788330255.264177:0:15114:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99eec9884800), last request at 1788329974 00000020:00000080:3.0:1788330255.264191:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd09d4 00000020:00010000:3.0:1788330255.264195:0:15114:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99eec9884800: total 2 00000100:00080000:3.0:1788330255.264199:0:15114:0:(import.c:65:import_set_state_nolock()) ffff99eec9885800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788330255.264216:0:15114:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99eec9884800): rc 0 00000020:00080000:3.0:1788330255.264220:0:15114:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff99eee76c4d28) has no exports 00000100:00100000:0.0:1788330255.264418:0:6515:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff99eef8169e00:6515] 0 exiting: rc = 1 00000100:00100000:0.0:1788330255.264538:0:6517:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff99eef8184200:6517] 2 exiting: rc = 0 00000020:00000080:0.0:1788330255.264595:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eef59f8000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788330255.264602:0:36:0:(genops.c:885:class_export_put()) final put ffff99eefe764800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788330255.264605:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eefe764800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1788330255.264609:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788330255.264673:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedfe68000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788330255.264677:0:36:0:(genops.c:885:class_export_put()) final put ffff99eedfe4d000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788330255.264680:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedfe4d000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788330255.264683:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788330255.264708:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedfe6f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1788330255.277932:0:6511:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99eec9884800: total 0 00010000:00010000:3.0:1788330255.278011:0:6511:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99eec9884800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788330255.278068:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c3c00/0x8475908e9fd0f1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd0f14 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330255.278094:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec147ae00/0x8475908e9fd0ad0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd0ac9 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330255.278109:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef59ca800/0x8475908e9fd0f0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd0f06 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330255.278120:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99edc765a600/0x8475908e9fd1175 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd116e expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330255.278129:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c3000/0x8475908e9fd0f45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd0f3e expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330255.278139:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef6e78e00/0x8475908e9fd1183 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd117c expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330255.278168:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec147a600/0x8475908e9fd0ade lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd0ad7 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330255.278183:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec147a400/0x8475908e9fd0df5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd0dee expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330255.278194:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c2400/0x8475908e9fd0ed5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd0ece expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330255.278204:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c3800/0x8475908e9fd0ee3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd0edc expref: 5 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330255.278216:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99edc765bc00/0x8475908e9fd1191 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd118a expref: 4 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330255.278241:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef6e79a00/0x8475908e9fd0ef1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd0eea expref: 3 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330255.278250:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef58c2a00/0x8475908e9fd0eff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8475908e9fd0ef8 expref: 2 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330255.278260:0:6511:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99eec9884800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788330255.278274:0:6511:0:(genops.c:885:class_export_put()) final put ffff99eec9884800/cfe8163f-ff22-4eb0-b728-b3e96f32c3cf 00010000:00010000:3.0:1788330255.278297:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330255.278299:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330255.278301:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788330255.281824:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eec9884800/cfe8163f-ff22-4eb0-b728-b3e96f32c3cf for MGS 00000020:00000080:0.0:1788330255.281897:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eec9885800 for MGS 00000100:00100000:3.0:1788330255.326828:0:6516:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff99eef8182a00:6516] 1 exiting: rc = 0 00000100:00100000:0.0:1788330255.326967:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.326978:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.326984:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.326990:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.326998:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327004:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327010:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327015:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327021:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327027:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327035:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327041:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327047:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327052:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327058:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327089:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327095:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327101:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327108:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327114:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327121:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327127:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327135:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327142:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327167:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327175:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327181:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327187:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327193:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327199:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327204:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327210:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327215:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327219:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327224:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327229:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327234:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327239:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327245:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327251:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327257:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327262:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327267:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327273:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327279:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327284:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327290:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327295:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327301:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327305:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327318:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327323:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327329:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327335:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327339:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327345:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327350:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327355:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327360:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327366:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327371:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327376:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327383:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330255.327400:0:15114:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788330255.329993:0:15114:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99eecaeb48a0 - data ffff99eedfa78510/ffff99edc76c2400 00000020:01000000:0.0:1788330255.330140:0:15114:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99eed0b1bde0 - data ffff99eedf8921b0/ffff99eec99a9c00 00000020:00000080:0.0:1788330255.331414:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd09b8 00000020:00000080:0.0:1788330255.331426:0:15114:0:(genops.c:885:class_export_put()) final put ffff99eed0687800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788330255.331934:0:15114:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99eec865b000 from MGS, refs=2 00000020:01000004:0.0:1788330255.331938:0:15114:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eec865b000 2 00000020:01000004:0.0:1788330255.331942:0:15114:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99eec865b000 from MGS 00000020:00000080:0.0:1788330255.331969:0:15114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788330255.331977:0:15114:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788330255.331981:0:15114:0:(genops.c:885:class_export_put()) final put ffff99eed0685000/MGS 00000020:00000080:0.0:1788330255.331984:0:15114:0:(genops.c:844:class_export_destroy()) destroying export ffff99eed0685000/MGS for MGS 00000020:01000000:0.0:1788330255.331995:0:15114:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:3.0:1788330255.332172:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99eed0687800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788330255.332312:0:15114:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788330255.332317:0:15114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788330255.332323:0:15114:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788330255.332331:0:15114:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99eedfe4e000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788330255.332337:0:15114:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff99eef58319b8) has exports, disconnecting them 00000020:00080000:0.0:1788330255.332343:0:15114:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99eedfe4e000), last request at 1788329975 00000020:00000080:0.0:1788330255.332348:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0a83 00000020:00080000:0.0:1788330255.332371:0:15114:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99eedfe4e000): rc 0 00000020:00000080:0.0:1788330255.332377:0:15114:0:(genops.c:885:class_export_put()) final put ffff99eedfe4e000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788330255.332595:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedfe4e000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:00010000:3.0:1788330255.362352:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:01000000:0.0:1788330255.373934:0:15114:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788330255.373945:0:15114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788330255.373950:0:15114:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788330255.373959:0:15114:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788330255.374288:0:15114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788330255.374297:0:15114:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788330255.374304:0:15114:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eec865b000 1 00000020:00000080:0.0:1788330255.374310:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd09aa 00000020:00000080:0.0:1788330255.374319:0:15114:0:(genops.c:885:class_export_put()) final put ffff99eed0686800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788330255.375021:0:13408:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eedfe4f800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788330255.375030:0:13408:0:(genops.c:885:class_export_put()) final put ffff99eedfe6c800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788330255.375033:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedfe6c800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788330255.375047:0:13408:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1788330255.375337:0:15114:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788330255.375344:0:15114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788330255.375351:0:15114:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788330255.375356:0:15114:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff99eee7574d28) has no exports 00000020:00000080:3.0:1788330255.379248:0:13408:0:(genops.c:844:class_export_destroy()) destroying export ffff99eed0686800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788330255.484108:0:15114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330255.484121:0:15114:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788330255.484127:0:15114:0:(genops.c:885:class_export_put()) final put ffff99eec970e000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788330255.484132:0:15114:0:(genops.c:844:class_export_destroy()) destroying export ffff99eec970e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788330255.484139:0:15114:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788330255.485072:0:15114:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99eec9709800 00000020:02000400:3.0:1788330255.485143:0:15114:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1788330255.776222:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792425856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330255.776335:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330255.776452:0:11624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792425856 00000100:00100000:2.0:1788330255.776464:0:11624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792425856 00000100:00100000:2.0:1788330255.776540:0:11624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788330255.776554:0:11624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792425856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788330255.776598:0:11624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788330255.776658:0:11624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8453480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792425856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330255.776666:0:11624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:2.0:1788330255.776696:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788330255.776745:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792425856:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788330256.411903:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330257.316638:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792425984:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330257.316717:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330257.316976:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792425984 00000100:00100000:0.0:1788330257.316986:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792425984 00000100:00100000:0.0:1788330257.317061:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788330257.317073:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792425984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788330257.317106:0:8442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788330257.317181:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330257.325713:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792425984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8628us (8981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330257.325733:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788330257.329104:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792425984:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788330257.435531:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330258.459321:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330258.847617:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792426112:0@lo:400:kworker.0 00000400:00000100:0.0:1788330258.847681:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875199792426112 offset 0 length 224: 4 00000100:00080000:2.0:1788330258.847887:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788330258.847892:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788330258.847896:0:37:0:(import.c:65:import_set_state_nolock()) ffff99eefe46b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330258.847902:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 457 00000100:00080000:2.0:1788330258.847921:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788330258.847928:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99eefe46b000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330258.847955:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc8451500 x1875199792426240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788330258.848001:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792426240:0@lo:38:kworker.0 00000100:00100000:1.0:1788330258.848050:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788330258.848093:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788330258.848097:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788330258.848099:0:37:0:(import.c:65:import_set_state_nolock()) ffff99eefe444800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330258.848103:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 457 00000100:00080000:2.0:1788330258.848106:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788330258.848110:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99eefe444800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330258.848124:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc8452680 x1875199792426368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788330258.848417:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875199792426368:0@lo:38:kworker.0 00000100:00100000:1.0:1788330258.848531:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330258.848619:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792426240 00000100:00100000:1.0:1788330258.848628:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792426240 00000100:00100000:1.0:1788330258.848675:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788330258.848683:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875199792426240:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788330258.848718:0:6528:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788330258.848770:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875199792426240:12345-0@lo:38:kworker.0 Request processed in 86us (720us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788330258.848778:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:1.0:1788330258.848817:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eefe46b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330258.848822:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788330258.848825:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792426240:0@lo:38:kworker.0 00000100:00080000:2.0:1788330258.849026:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788330258.849030:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788330258.849032:0:37:0:(import.c:65:import_set_state_nolock()) ffff99edc5f37000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330258.849037:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 457 00000100:00080000:2.0:1788330258.849040:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788330258.849044:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99edc5f37000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330258.849062:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc8451500 x1875199792426496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788330258.849110:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788330258.849114:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788330258.849116:0:37:0:(import.c:65:import_set_state_nolock()) ffff99edc5f36000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330258.849120:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 457 00000100:00080000:2.0:1788330258.849129:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788330258.849133:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99edc5f36000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330258.849147:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7798380 x1875199792426880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788330258.849210:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792426752:0@lo:400:kworker.0 00000100:00100000:2.0:1788330258.849248:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330258.849273:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330258.849279:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792427008:0@lo:400:kworker.0 00000100:00100000:2.0:1788330258.849301:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330258.849354:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792426624:0@lo:400:kworker.0 00000100:00100000:1.0:1788330258.849402:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875199792426496:0@lo:38:kworker.0 00000100:00100000:2.0:1788330258.849719:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792427136:0@lo:400:kworker.0 00000100:00100000:2.0:1788330258.849758:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330258.849853:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792426368 00000100:00100000:0.0:1788330258.849860:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792426368 00000100:00100000:0.0:1788330258.849898:0:7832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792427008 00000100:00100000:0.0:1788330258.849902:0:7832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792427008 00000100:00100000:0.0:1788330258.849954:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1788330258.849963:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792427008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330258.850015:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875199792427008:12345-0@lo:400:kworker.0 Request processed in 54us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330258.850021:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1788330258.850038:0:7832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788330258.850042:0:7832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875199792426368:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788330258.850060:0:7832:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788330258.850087:0:7832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875199792426368:12345-0@lo:38:kworker.0 Request processed in 43us (1558us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788330258.850094:0:7832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788330258.850238:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792426752 00000100:00100000:0.0:1788330258.850243:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792426752 00000100:00100000:0.0:1788330258.850270:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792427136 00000100:00100000:0.0:1788330258.850273:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792427136 00000100:00100000:0.0:1788330258.850295:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788330258.850302:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792426752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330258.850339:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792426752:12345-0@lo:400:kworker.0 Request processed in 37us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330258.850345:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788330258.850357:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788330258.850375:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792427136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330258.850409:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792427136:12345-0@lo:400:kworker.0 Request processed in 47us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330258.850416:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:0.0:1788330258.850561:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330258.850654:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788330258.850697:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff99edc5ee8380 x1875199792427008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330258.850712:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792427008:0@lo:400:kworker.0 00000100:00100000:0.0:1788330258.850725:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792426752:0@lo:400:kworker.0 00000100:00100000:0.0:1788330258.850767:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792427136:0@lo:400:kworker.0 00000100:00100000:1.0:1788330258.852747:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330258.852857:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330258.859944:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875199792426880:0@lo:38:kworker.0 00000100:00100000:1.0:1788330258.860063:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330258.861180:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792426624 00000100:00100000:0.0:1788330258.861193:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792426624 00000100:00080000:3.0:1788330258.861248:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788330258.861274:0:12916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792426496 00000100:00100000:0.0:1788330258.861279:0:12916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792426496 00000100:00100000:0.0:1788330258.861313:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1788330258.861324:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792426624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330258.861415:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792426624:12345-0@lo:400:kworker.0 Request processed in 93us (8686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330258.861422:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1788330258.861444:0:12916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788330258.861449:0:12916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1875199792426496:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788330258.861476:0:12916:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788330258.861508:0:12916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1875199792426496:12345-0@lo:38:kworker.0 Request processed in 58us (8651us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788330258.861514:0:12916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:1.0:1788330258.869044:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eefe444800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330258.869059:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788330258.869065:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875199792426368:0@lo:38:kworker.0 00000100:00080000:1.0:1788330258.869100:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc5f37000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330258.869104:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788330258.869107:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875199792426496:0@lo:38:kworker.0 00010000:00080000:1.0:1788330258.869183:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff99eeffcfbb80 x1875199792426624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330258.869195:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792426624:0@lo:400:kworker.0 00000100:00100000:0.0:1788330258.870368:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792426880 00000100:00100000:0.0:1788330258.870382:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792426880 00000100:00100000:0.0:1788330258.870431:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788330258.870439:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875199792426880:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788330258.870461:0:6523:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788330258.870546:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875199792426880:12345-0@lo:38:kworker.0 Request processed in 106us (10482us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788330258.870554:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:1.0:1788330258.870705:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc5f36000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330258.870718:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788330258.870722:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875199792426880:0@lo:38:kworker.0 00000040:00080000:0.0:1788330258.909334:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788330259.484241:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788330259.837730:0:15316:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788330259.857074:0:15316:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1788330259.857142:0:15316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78600/0x8475908e9fd0f06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f0d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.857389:0:15316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78600/0x8475908e9fd0f06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0f0d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.857397:0:15316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78600/0x8475908e9fd0f06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0f0d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.857404:0:15316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eef6e78600/0x8475908e9fd0f06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0f0d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.857586:0:15316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788330259.857594:0:15316:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788330259.857620:0:15316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788330259.857624:0:15316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788330259.857630:0:15316:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788330259.857637:0:15316:0:(import.c:65:import_set_state_nolock()) ffff99eefe444800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788330259.857642:0:15316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788330259.857643:0:15316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788330259.857646:0:15316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788330259.859015:0:15316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cae00/0x8475908e9fd0f14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0f1b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.859032:0:15316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cae00/0x8475908e9fd0f14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0f1b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.859061:0:15316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cae00/0x8475908e9fd0f14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0f1b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.859068:0:15316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eef59cae00/0x8475908e9fd0f14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0f1b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.859140:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330259.859364:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef6e78600/0x8475908e9fd0f06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0f0d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.859372:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78600 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330259.859375:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e78600/0x8475908e9fd0f06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0f0d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.859384:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef6e78600/0x8475908e9fd0f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd0f0d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330259.859391:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e78600/0x8475908e9fd0f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd0f0d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330259.859407:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788330259.859409:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788330259.859412:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788330259.859541:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef6e78600/0x8475908e9fd0f06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd0f0d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.859548:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330259.859578:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef6e78600/0x8475908e9fd0f06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd0f0d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.859584:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef6e78600/0x8475908e9fd0f06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd0f0d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.859597:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330259.859600:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef59cae00/0x8475908e9fd0f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0f1b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.859606:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cae00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330259.859608:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef59cae00/0x8475908e9fd0f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0f1b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.859614:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef59cae00/0x8475908e9fd0f14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd0f1b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330259.859620:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef59cae00/0x8475908e9fd0f14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd0f1b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330259.859625:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788330259.859627:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1788330259.859638:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef59cae00/0x8475908e9fd0f14 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd0f1b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.859648:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330259.859666:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef59cae00/0x8475908e9fd0f14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd0f1b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.859674:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330259.859675:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330259.859677:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330259.859849:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330259.859861:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792427264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330259.859927:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330259.859983:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792427392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330259.860006:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330259.860036:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792427392 00000100:00100000:0.0:1788330259.860036:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792427264 00000100:00100000:1.0:1788330259.860042:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792427392 00000100:00100000:0.0:1788330259.860042:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792427264 00000100:00100000:1.0:1788330259.860081:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788330259.860089:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1875199792427392:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788330259.860096:0:6509:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788330259 with bad export cookie 596543370470164948 00010000:00010000:2.0:1788330259.863275:0:15316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788330259.863292:0:15316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef59cae00/0x8475908e9fd0f14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd0f1b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.863319:0:15316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0dee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0df5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.863327:0:15316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0dee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0df5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.863334:0:15316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0dee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0df5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.863341:0:15316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0dee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0df5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330259.863543:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788330259.863553:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1875199792427264:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788330259.863561:0:6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788330259 with bad export cookie 596543370470164948 00000100:00100000:0.0:1788330259.863653:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1875199792427264:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (3726us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788330259.863661:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788330259.863710:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788330259.863715:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99eec9881800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788330259.863729:0:3648:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.150@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1788330259.866593:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330259.866610:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0dee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0df5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.866623:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c2200 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330259.866628:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0dee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0df5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.866640:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0dee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd0df5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330259.866648:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0dee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd0df5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330259.866655:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788330259.866658:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000100:00100000:1.0:1788330259.867699:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1875199792427392:12345-0@lo:103:ldlm_bl.0 Request processed in 7592us (7675us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788330259.867711:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788330259.867861:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:2.0:1788330259.867926:0:15316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:2.0:1788330259.867936:0:15316:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788330259.867951:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330259.867966:0:15316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765ba00/0x8475908e9fd118a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1191 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.867975:0:15316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765ba00/0x8475908e9fd118a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd1191 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.868002:0:15316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765ba00/0x8475908e9fd118a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd1191 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.868009:0:15316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99edc765ba00/0x8475908e9fd118a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd1191 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.868022:0:15316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330259.868028:0:15316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eeef91b800/0x8475908e9fd0ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ade expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.868034:0:15316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eeef91b800/0x8475908e9fd0ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0ade expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.868039:0:15316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eeef91b800/0x8475908e9fd0ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0ade expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.868044:0:15316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eeef91b800/0x8475908e9fd0ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0ade expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.868051:0:15316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788330259.868055:0:15316:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1788330259.868057:0:15316:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:2.0:1788330259.868087:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788330259.868092:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99edc765ba00/0x8475908e9fd118a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd1191 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.868098:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765ba00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:2.0:1788330259.868101:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99edc765ba00/0x8475908e9fd118a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd1191 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.868119:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99edc765ba00/0x8475908e9fd118a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd1191 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330259.868125:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99edc765ba00/0x8475908e9fd118a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd1191 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330259.868131:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788330259.868133:0:10341:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788330259.868135:0:10341:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:0.0:1788330259.883732:0:3648:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.150@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788330259.883739:0:3648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788330259.883749:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99edc8451880 x1875199792426112/t0(0) o400->MGC192.168.202.150@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788330274 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330259.883775:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eeffd68e00 x1875199792427264/t0(0) o103->MGC192.168.202.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788330275 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330259.883813:0:3648:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eeffd6b480 x1875199792427392/t0(0) o103->MGC192.168.202.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788330275 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788330259.883972:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788330259.883975:0:3648:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788330259.883977:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:3.0:1788330259.884049:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0dee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd0df5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.884059:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330259.884093:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0dee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd0df5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.884112:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef58c2200/0x8475908e9fd0dee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd0df5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.884140:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330259.884145:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eeef91b800/0x8475908e9fd0ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0ade expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.884166:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91b800 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330259.884169:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eeef91b800/0x8475908e9fd0ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0ade expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.884179:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eeef91b800/0x8475908e9fd0ad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd0ade expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330259.884186:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eeef91b800/0x8475908e9fd0ad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd0ade expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330259.884191:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788330259.884194:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788330259.884197:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788330259.884209:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99eec9881800 00010000:00010000:3.0:1788330259.884211:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eeef91b800/0x8475908e9fd0ad7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd0ade expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.884216:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eeef91b800/0x8475908e9fd0ad7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd0ade expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330259.884232:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330259.884233:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330259.884240:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330259.884352:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:0:1875199792427520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330259.884379:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788330259.884447:0:3646:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99eec9881800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788330259.884460:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3646:1875199792427392:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330259.885099:0:10341:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99edc765ba00/0x8475908e9fd118a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd1191 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.885109:0:10341:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788330259.885137:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99edc765ba00/0x8475908e9fd118a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd1191 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.885144:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99edc765ba00/0x8475908e9fd118a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8475908e9fd1191 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330259.885175:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330259.885177:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330259.885179:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788330259.885197:0:15316:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788330259.885202:0:15316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788330259.885208:0:15316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330259.885214:0:15316:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788330259.885220:0:15316:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff99edc70ed800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788330259.885226:0:15316:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff99edc65eb000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788330259.885230:0:15316:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff99eefd333370) has exports, disconnecting them 00000020:00080000:2.0:1788330259.885246:0:15316:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff99edc70ed800), last request at 1788330258 00000020:00000080:2.0:1788330259.885253:0:15316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0db6 00000100:00080000:2.0:1788330259.885273:0:15316:0:(import.c:65:import_set_state_nolock()) ffff99edc70ef800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788330259.885323:0:15316:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99edc70ed800): rc 0 00000020:00000080:2.0:1788330259.885325:0:15316:0:(genops.c:885:class_export_put()) final put ffff99edc70ed800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788330259.885337:0:15316:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff99edc65eb000), last request at 1788330258 00000020:00000080:2.0:1788330259.885340:0:15316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0c90 00000100:00080000:2.0:1788330259.885346:0:15316:0:(import.c:65:import_set_state_nolock()) ffff99edc65ee800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788330259.885353:0:15316:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99edc65eb000): rc 0 00000020:00000080:2.0:1788330259.885355:0:15316:0:(genops.c:885:class_export_put()) final put ffff99edc65eb000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788330259.885362:0:15316:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb7bcc19ffae0 00000100:00080000:2.0:1788330259.885380:0:15316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788330259.885387:0:15316:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff99eefd32d180 x1875199792424192/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788330269 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330259.885397:0:15316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1788330259.886415:0:15316:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788330259.886424:0:15316:0:(import.c:65:import_set_state_nolock()) ffff99eefe46b000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:3.0:1788330259.886633:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330259.886653:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:0:1875199792427648:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330259.886672:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330259.886677:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788330259.886749:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc70ed800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00080000:0.0:1788330259.887004:0:3648:0:(import.c:65:import_set_state_nolock()) ffff99eec9881800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788330259.887011:0:3648:0:(import.c:510:import_select_connection()) MGC192.168.202.150@tcp: connect to NID 0@lo last attempt 178 00000100:00080000:0.0:1788330259.887019:0:3648:0:(import.c:624:import_select_connection()) MGC192.168.202.150@tcp: import ffff99eec9881800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:0.0:1788330259.887243:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eefd32ea00 x1875199792427776/t0(0) o250->MGC192.168.202.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788330259.887283:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792426112:0@lo:400:kworker.0 00000100:00100000:0.0:1788330259.887291:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792424192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330259.887313:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3648:1875199792427264:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788330259.887427:0:15316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788330259.887432:0:15316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1788330259.887517:0:15316:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788330259.887576:0:15316:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788330259.887589:0:15316:0:(import.c:65:import_set_state_nolock()) ffff99eefd33a800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788330259.887596:0:15316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788330259.887598:0:15316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1788330259.887609:0:15316:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788330259.887677:0:15316:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788330259.887685:0:15316:0:(import.c:65:import_set_state_nolock()) ffff99edc75d7800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788330259.887710:0:15316:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff99eefd333370) has no exports 00000020:00000080:1.0:1788330259.888001:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc65eb000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788330259.888103:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc70ef800 for lustre-MDT0001 00000020:00000080:1.0:1788330259.888110:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc65ee800 for lustre-MDT0001 00000100:00100000:1.0:1788330259.888129:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3645:1875199792427776:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788330259.889241:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875199792427776 offset 0 length 520: 4 00000100:00100000:1.0:1788330259.889292:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792427904:0@lo:9:umount.0 00000100:00100000:1.0:1788330259.889336:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330259.889399:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792428032:0@lo:9:umount.0 00000100:00100000:1.0:1788330259.889420:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330259.889879:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792427904 00000100:00100000:2.0:1788330259.889962:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792427904 00000100:00100000:2.0:1788330259.890038:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792428032 00000100:00100000:2.0:1788330259.890042:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792428032 00000100:00100000:2.0:1788330259.890069:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788330259.890078:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875199792427904:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788330259.890108:0:8439:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0cdd 00000100:00080000:2.0:1788330259.890117:0:8439:0:(import.c:65:import_set_state_nolock()) ffff99edc5c6c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788330259.890182:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788330259.890344:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3645:x1875199792427904:12345-0@lo:9:umount.0 Request processed in 266us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330259.890352:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788330259.890366:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788330259.890372:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875199792428032:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788330259.890383:0:8439:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0e1f 00000100:00080000:2.0:1788330259.890388:0:8439:0:(import.c:65:import_set_state_nolock()) ffff99eedfe1f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788330259.890406:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:2.0:1788330259.890552:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3645:x1875199792428032:12345-0@lo:9:umount.0 Request processed in 180us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330259.890558:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1788330259.890611:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eefd33a800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788330259.890624:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788330259.890626:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788330259.890630:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792427904:0@lo:9:umount.0 00000100:00080000:2.0:1788330259.890641:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc75d7800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788330259.890648:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788330259.890649:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788330259.890652:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792428032:0@lo:9:umount.0 00010000:00010000:2.0:1788330259.890702:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330259.890707:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788330259.891042:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:3.0:1788330259.898557:0:15316:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff99eefd333370) has no exports 00000020:01000000:1.0:1788330259.988371:0:15316:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99eef6e53660 - data ffff99eedfb2cca8/ffff99edc76a7000 00000020:01000000:1.0:1788330259.988623:0:15316:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99eefd3237e0 - data ffff99eedf9b7948/ffff99eefdb42000 00000001:00000004:1.0:1788330260.011850:0:15316:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1788330260.080548:0:15316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788330260.080559:0:15316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788330260.080569:0:15316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788330260.087924:0:15316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788330260.087932:0:15316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788330260.087954:0:15316:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788330260.087957:0:15316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788330260.088683:0:8623:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788330260.088689:0:8623:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1788330260.088700:0:8623:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788330260.089568:0:15316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788330260.089575:0:15316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788330260.089600:0:15316:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788330260.089603:0:15316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788330260.090598:0:9986:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788330260.090604:0:9986:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788330260.090617:0:9986:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788330260.093582:0:15316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0afa 00000020:00000080:3.0:1788330260.093595:0:15316:0:(genops.c:885:class_export_put()) final put ffff99eef5b4d000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788330260.095857:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef5b4d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788330260.096231:0:15316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0b0f 00000020:00000080:3.0:1788330260.096244:0:15316:0:(genops.c:885:class_export_put()) final put ffff99eef5b4b800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788330260.096320:0:15316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788330260.096327:0:15316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788330260.096336:0:15316:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788330260.096340:0:15316:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff99eefd330000) has no exports 00000020:00000080:1.0:1788330260.096584:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef5b4b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:3.0:1788330260.096712:0:15316:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788330260.096731:0:15316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0e18 00000020:00000080:3.0:1788330260.096737:0:15316:0:(genops.c:885:class_export_put()) final put ffff99edc75d5800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788330260.096787:0:15316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788330260.096805:0:15316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788330260.096814:0:15316:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788330260.096817:0:15316:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff99eeffc48000) has no exports 00000020:00000080:3.0:1788330260.096823:0:15316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0e11 00000020:00000080:3.0:1788330260.096828:0:15316:0:(genops.c:885:class_export_put()) final put ffff99edc75d0800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788330260.098274:0:15316:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788330260.098282:0:15316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788330260.098287:0:15316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788330260.098296:0:15316:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788330260.098298:0:15316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788330260.098348:0:15316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330260.098360:0:15316:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788330260.098366:0:15316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0cd6 00000020:00000080:3.0:1788330260.098373:0:15316:0:(genops.c:885:class_export_put()) final put ffff99eedfe6e800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788330260.098382:0:15316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788330260.098392:0:15316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788330260.098397:0:15316:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788330260.098400:0:15316:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff99eef5830000) has no exports 00000020:00000080:3.0:1788330260.098406:0:15316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0ccf 00000020:00000080:3.0:1788330260.098410:0:15316:0:(genops.c:885:class_export_put()) final put ffff99eedfe4a000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788330260.098768:0:15316:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788330260.098771:0:15316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788330260.098773:0:15316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788330260.098777:0:15316:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788330260.098778:0:15316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788330260.098815:0:15316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330260.098821:0:15316:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788330260.098834:0:15316:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788330260.098840:0:15316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0b32 00000020:00000080:3.0:1788330260.098846:0:15316:0:(genops.c:885:class_export_put()) final put ffff99eefe440800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788330260.098854:0:15316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788330260.098864:0:15316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788330260.098880:0:15316:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788330260.098882:0:15316:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff99eee75719b8) has no exports 00000020:00000080:3.0:1788330260.098886:0:15316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0b2b 00000020:00000080:3.0:1788330260.098890:0:15316:0:(genops.c:885:class_export_put()) final put ffff99eefe46f000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788330260.100224:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc75d5800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788330260.100240:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc75d0800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788330260.100246:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc75d7800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788330260.100255:0:37:0:(genops.c:885:class_export_put()) final put ffff99edc75d1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788330260.100258:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc75d1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788330260.100263:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788330260.100362:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedfe6e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788330260.100368:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedfe4a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788330260.100373:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eefd33a800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788330260.100378:0:37:0:(genops.c:885:class_export_put()) final put ffff99eef6de1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788330260.100381:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef6de1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788330260.100385:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788330260.100414:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eefe440800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788330260.100419:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eefe46f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788330260.211944:0:15316:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1788330260.211953:0:15316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788330260.211958:0:15316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1788330260.211967:0:15316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788330260.212123:0:15316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330260.212135:0:15316:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788330260.212202:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eefe46b000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788330260.212211:0:37:0:(genops.c:885:class_export_put()) final put ffff99eefe443800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788330260.212214:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eefe443800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788330260.212228:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788330260.212625:0:15316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330260.212630:0:15316:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788330260.212633:0:15316:0:(genops.c:885:class_export_put()) final put ffff99eef5b49800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788330260.212636:0:15316:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef5b49800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788330260.212642:0:15316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788330260.212779:0:15316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0b16 00000020:00000080:3.0:1788330260.212787:0:15316:0:(genops.c:885:class_export_put()) final put ffff99eef5b4a800/lustre-MDD0001_UUID 00000020:01000000:3.0:1788330260.212828:0:15316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788330260.212832:0:15316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788330260.212837:0:15316:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788330260.212840:0:15316:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff99eefd3319b8) has no exports 00000020:00000080:3.0:1788330260.212864:0:15316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330260.212868:0:15316:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788330260.212872:0:15316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0b1d 00000020:00000080:3.0:1788330260.212885:0:15316:0:(genops.c:885:class_export_put()) final put ffff99eef5b4e800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788330260.213689:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef5b4a800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788330260.213696:0:37:0:(genops.c:885:class_export_put()) final put ffff99eef5b4f800/lustre-MDD0001_UUID 00000020:00000080:1.0:1788330260.213698:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef5b4f800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788330260.213702:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:3.0:1788330260.219471:0:15316:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99eef59c6800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1788330260.219481:0:15316:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eef59c6800 2 00000020:01000004:3.0:1788330260.219484:0:15316:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99eef59c6800 from lustre-MDT0001 00000020:00000080:3.0:1788330260.219529:0:15316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330260.219540:0:15316:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788330260.219545:0:15316:0:(genops.c:885:class_export_put()) final put ffff99eef5b4e000/lustre-MDT0001_UUID 00000020:00000080:3.0:1788330260.219549:0:15316:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef5b4e000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788330260.219573:0:15316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788330260.219643:0:15316:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788330260.219647:0:15316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1788330260.219650:0:15316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788330260.219655:0:15316:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788330260.219662:0:15316:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff99eef58da000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788330260.219669:0:15316:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff99eef5834d28) has exports, disconnecting them 00000020:00080000:3.0:1788330260.219675:0:15316:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff99eef58da000), last request at 1788329996 00000020:00000080:3.0:1788330260.219679:0:15316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0b71 00000020:00080000:3.0:1788330260.219687:0:15316:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99eef58da000): rc 0 00000020:00000080:3.0:1788330260.219691:0:15316:0:(genops.c:885:class_export_put()) final put ffff99eef58da000/lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788330260.220382:0:15316:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788330260.220387:0:15316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788330260.220391:0:15316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788330260.220395:0:15316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788330260.220513:0:15316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330260.220517:0:15316:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788330260.220521:0:15316:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eef59c6800 1 00000020:00000080:3.0:1788330260.220525:0:15316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0aad 00000020:00000080:3.0:1788330260.220530:0:15316:0:(genops.c:885:class_export_put()) final put ffff99eef59c3800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788330260.220534:0:15316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788330260.220538:0:15316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788330260.220541:0:15316:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788330260.220544:0:15316:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff99eee7573370) has no exports 00000020:00000080:1.0:1788330260.226668:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef5b4e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788330260.226709:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef58da000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788330260.226729:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eefe444800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788330260.226740:0:37:0:(genops.c:885:class_export_put()) final put ffff99eef58dd000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788330260.226744:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef58dd000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788330260.226748:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788330260.226841:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef59c3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788330260.431672:0:15316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788330260.431691:0:15316:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788330260.431697:0:15316:0:(genops.c:885:class_export_put()) final put ffff99eef59c2800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788330260.431702:0:15316:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef59c2800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788330260.431728:0:15316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788330260.431858:0:15316:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99eef59c0000 00000020:01000000:1.0:1788330260.431880:0:15316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788330260.431884:0:15316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788330260.431889:0:15316:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788330260.431895:0:15316:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff99eee764cd28) has no exports 00000100:00100000:3.0:1788330260.432614:0:6522:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff99eec31b9800:6522] 0 exiting: rc = 1 00000100:00100000:3.0:1788330260.432967:0:7832:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff99eefe72d600:7832] 3 exiting: rc = 0 00000100:00100000:3.0:1788330260.437294:0:6524:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff99eec31b9e00:6524] 2 exiting: rc = 0 00000100:00100000:0.0:1788330260.441193:0:6523:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff99eed0fd7c00:6523] 1 exiting: rc = 0 00000100:00100000:0.0:1788330260.441376:0:12916:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff99edc7cd6e00:12916] 4 exiting: rc = 0 00000100:00100000:2.0:1788330260.441589:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441600:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441606:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441612:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441617:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441623:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441628:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441634:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441640:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441645:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441651:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441656:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441663:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441668:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441673:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441679:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441684:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441690:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441696:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441702:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441708:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441727:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441734:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441742:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441748:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441753:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441758:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441763:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441768:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441774:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441779:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441784:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441808:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441813:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441819:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441825:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441831:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441837:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441843:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441848:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441854:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441860:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441865:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441872:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441878:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441884:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441888:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441893:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441898:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441905:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441911:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441916:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441922:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441929:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441935:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441942:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441948:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441954:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441960:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441965:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441972:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441977:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441983:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.441988:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330260.444398:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff99eecad8fe00:6526] 1 exiting: rc = 0 00000100:00100000:0.0:1788330260.444547:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff99eec5ce8200:6525] 0 exiting: rc = 1 00000100:00100000:2.0:1788330260.445097:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.445108:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.445114:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.445133:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.445139:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.445146:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448426:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448442:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448448:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448454:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448461:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448468:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448477:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448482:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448488:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448492:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448497:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448502:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448508:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448513:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448518:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448523:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448528:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448533:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448538:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448542:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448547:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448552:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448558:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448562:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448569:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448574:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448579:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448585:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448591:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448597:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448602:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448608:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448636:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448641:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448655:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448662:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448667:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448672:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448677:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448683:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448688:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448694:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448699:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448705:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448710:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448729:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448735:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448741:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448746:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448751:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448756:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448761:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448766:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448771:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448777:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448782:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448787:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.448793:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330260.454248:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff99eec91c0800:6528] 1 exiting: rc = 0 00000100:00100000:2.0:1788330260.460272:0:7831:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff99eefe75a800:7831] 2 exiting: rc = 0 00000100:00100000:0.0:1788330260.460929:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff99eec8f5fa00:6527] 0 exiting: rc = 1 00000100:00100000:1.0:1788330260.461134:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461145:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461186:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461197:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461204:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461211:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461218:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461225:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461233:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461240:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461247:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461269:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461279:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461285:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461299:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461322:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461346:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461352:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461359:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461365:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461372:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461380:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461386:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461392:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461399:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461405:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461411:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461433:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461443:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461448:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461455:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461465:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461472:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461481:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461487:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461495:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461501:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461508:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461518:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461542:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461550:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461557:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461563:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461569:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461576:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461582:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461588:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461594:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461599:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461606:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461612:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461637:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461644:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461650:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461657:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461663:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461668:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461673:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461679:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461685:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461691:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461698:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461704:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.461730:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.483924:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff99eec98c1600:6529] 0 exiting: rc = 1 00000100:00100000:2.0:1788330260.490489:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99eec98c0a00:6530] 1 exiting: rc = 0 00000100:00100000:1.0:1788330260.490945:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.490953:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.490959:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.490964:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.490970:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.490975:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.490980:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.490986:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.490991:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.490997:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491002:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491008:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491013:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491019:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491024:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491030:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491034:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491039:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491043:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491048:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491052:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491057:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491082:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491087:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491093:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491098:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491102:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491107:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491113:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491118:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491124:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491128:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491133:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491138:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491144:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491177:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491184:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491190:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491195:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491200:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491206:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491211:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491217:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491221:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491227:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491233:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491238:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491243:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491248:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491253:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491258:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491263:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491269:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491273:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491278:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491284:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491289:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491302:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491307:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491312:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491318:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491322:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491328:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491333:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.491814:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff99eec98c0c00:6531] 0 exiting: rc = 1 00000100:00100000:2.0:1788330260.494265:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff99eec98c0600:6532] 1 exiting: rc = 0 00000100:00100000:1.0:1788330260.494499:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494508:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494513:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494518:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494525:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494530:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494534:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494540:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494545:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494549:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494554:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494558:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494563:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494567:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494572:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494577:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494582:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494587:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494592:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494598:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494603:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494608:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494613:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494619:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494624:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494630:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494637:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494662:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494668:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494672:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494678:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494683:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494688:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494694:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494700:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494705:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494711:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494725:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494731:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494735:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494740:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494744:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494750:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494755:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494761:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494766:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494772:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494777:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494782:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494787:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494792:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494797:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494803:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494808:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494813:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494817:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494822:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494826:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494831:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494836:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494841:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494845:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494857:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.494861:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330260.499298:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff99eec98c0800:6533] 0 exiting: rc = 1 00000100:00100000:1.0:1788330260.503078:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff99eec98c0400:6534] 1 exiting: rc = 0 00000100:00100000:0.0:1788330260.503426:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503433:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503439:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503465:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503471:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503477:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503483:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503488:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503494:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503500:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503505:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503510:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503517:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503522:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503527:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503532:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503538:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503543:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503549:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503556:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503561:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503566:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503572:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503578:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503583:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503588:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503594:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503599:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503604:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503610:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503616:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503622:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503628:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503634:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503640:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503645:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503650:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503655:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503668:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503673:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503678:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503683:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503689:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503694:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503700:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503707:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503722:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503729:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503734:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503739:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503744:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503750:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503755:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503761:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503766:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503771:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503777:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503782:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503786:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503791:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503797:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503802:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503807:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.503812:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330260.504725:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff99eee7505400:6536] 1 exiting: rc = 0 00000100:00100000:2.0:1788330260.505104:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff99eee7504600:6535] 0 exiting: rc = 1 00000100:00100000:2.0:1788330260.505479:0:6537:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff99eee7504800:6537] 2 exiting: rc = 0 00000100:00100000:0.0:1788330260.505728:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505738:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505744:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505750:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505755:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505761:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505768:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505774:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505780:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505797:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505804:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505810:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505815:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505821:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505828:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505833:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505840:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505847:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505872:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505879:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505886:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505893:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505899:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505906:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505912:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505919:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505925:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505931:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505938:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505944:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505950:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505955:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505961:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505967:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505972:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505979:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505986:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505991:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.505997:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506003:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506008:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506015:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506035:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506042:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506053:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506060:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506066:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506071:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506077:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506083:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506089:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506094:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506100:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506107:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506113:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506119:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506126:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506132:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506138:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506144:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506172:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506179:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506185:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330260.506190:0:15316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1788330260.512388:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788330260.516730:0:15316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788330260.516748:0:15316:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788330260.516753:0:15316:0:(genops.c:885:class_export_put()) final put ffff99eee757c800/MDS_uuid 00000020:00000080:1.0:1788330260.516758:0:15316:0:(genops.c:844:class_export_destroy()) destroying export ffff99eee757c800/MDS_uuid for MDS 00000020:01000000:1.0:1788330260.516770:0:15316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788330260.516939:0:15316:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788330261.533836:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330262.555657:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330263.579429:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788330263.963362:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) cfe8163f-ff22-4eb0-b728-b3e96f32c3cf->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788330263.963376:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) cfe8163f-ff22-4eb0-b728-b3e96f32c3cf->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788330263.963379:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788330263.963382:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788330263.963392:0:36:0:(import.c:65:import_set_state_nolock()) ffff99edc5f37000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330263.963402:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 462 00000100:00080000:1.0:1788330263.963408:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788330263.963417:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99edc5f37000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330263.963464:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7e76300 x1875199792428160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788330263.963525:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788330263.963529:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788330263.963530:0:36:0:(import.c:65:import_set_state_nolock()) ffff99edc5f36000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330263.963534:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 462 00000100:00080000:1.0:1788330263.963536:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788330263.963541:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99edc5f36000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330263.963584:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7e77480 x1875199792428416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788330263.963623:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788330263.963641:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792428288:0@lo:400:kworker.0 00000400:00000100:1.0:1788330263.963704:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792428288 offset 0 length 224: 4 00000100:00100000:1.0:1788330263.963778:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792428544:0@lo:400:kworker.0 00000400:00000100:1.0:1788330263.963799:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792428544 offset 0 length 224: 4 00000100:00100000:2.0:1788330263.963973:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875199792428160:0@lo:38:kworker.0 00000400:00000100:2.0:1788330263.963999:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792428160 offset 0 length 520: 4 00000100:00100000:2.0:1788330263.964019:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875199792428416:0@lo:38:kworker.0 00000400:00000100:2.0:1788330263.964033:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792428416 offset 0 length 520: 4 00010000:00010000:2.0:1788330264.606595:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788330265.000046:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) cfe8163f-ff22-4eb0-b728-b3e96f32c3cf->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788330265.000074:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) cfe8163f-ff22-4eb0-b728-b3e96f32c3cf->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788330265.000077:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788330265.001511:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788330265.001612:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792428672:0@lo:400:kworker.0 00000400:00000100:1.0:1788330265.001663:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792428672 offset 0 length 224: 4 00000100:00080000:3.0:1788330265.002755:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788330265.002762:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788330265.002823:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330265.002838:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792428800:0@lo:400:kworker.0 00000400:00000100:3.0:1788330265.002870:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792428800 offset 0 length 224: 4 00000020:01000004:0.0:1788330265.370825:0:15516:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788330265.391756:0:15516:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788330265.391815:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78800/0x8475908e9fd0eea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ef1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330265.391842:0:15516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78800/0x8475908e9fd0eea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0ef1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330265.391850:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78800/0x8475908e9fd0eea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0ef1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330265.391857:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eef6e78800/0x8475908e9fd0eea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0ef1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330265.391874:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788330265.391880:0:15516:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788330265.391907:0:15516:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788330265.391918:0:15516:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99edc7e76300 x1875199792428160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788330283 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330265.391964:0:15516:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788330265.391998:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc5f37000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330265.392003:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:1.0:1788330265.392007:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875199792428160:0@lo:38:kworker.0 00000100:00080000:1.0:1788330265.392043:0:15516:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788330265.392049:0:15516:0:(import.c:65:import_set_state_nolock()) ffff99edc5f37000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788330265.392055:0:15516:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788330265.392057:0:15516:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788330265.392060:0:15516:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788330265.393268:0:15516:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788330265.393283:0:15516:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99edc7e74a80 x1875199792428288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330279 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330265.393316:0:15516:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99edc75fce00 x1875199792428672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330281 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330265.393405:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792428288:0@lo:400:kworker.0 00000100:00100000:1.0:1788330265.393482:0:15516:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:1.0:1788330265.393503:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875199792428672:0@lo:400:kworker.0 00010000:00010000:2.0:1788330265.393623:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330265.393632:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef6e78800/0x8475908e9fd0eea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0ef1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330265.393642:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78800 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:2.0:1788330265.393646:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e78800/0x8475908e9fd0eea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0ef1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330265.393656:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef6e78800/0x8475908e9fd0eea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd0ef1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330265.393664:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e78800/0x8475908e9fd0eea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd0ef1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330265.393680:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788330265.393683:0:10341:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788330265.393686:0:10341:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788330265.393708:0:10341:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99eec9881800 00010000:00010000:2.0:1788330265.393713:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef6e78800/0x8475908e9fd0eea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd0ef1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330265.393721:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef6e78800/0x8475908e9fd0eea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd0ef1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330265.393753:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330265.393755:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330265.393757:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788330265.397512:0:15516:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788330265.397550:0:15516:0:(import.c:65:import_set_state_nolock()) ffff99edc5f36800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788330265.397608:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875199792428928:0@lo:39:umount.0 00000400:00000100:1.0:1788330265.397682:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792428928 offset 0 length 224: 4 00010000:00010000:1.0:1788330265.628471:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788330266.025120:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788330266.025134:0:9518:0:(genops.c:885:class_export_put()) final put ffff99edc75d4800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788330266.025253:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc75d4800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788330266.025335:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eedfe1f000 for lustre-OST0001 00000001:00100000:3.0:1788330266.029219:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788330266.029236:0:8433:0:(genops.c:885:class_export_put()) final put ffff99edc5c6e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788330266.029323:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc5c6e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788330266.029396:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc5c6c000 for lustre-OST0000 00010000:00010000:2.0:1788330266.651418:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330267.675445:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330268.699407:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788330269.022805:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) cfe8163f-ff22-4eb0-b728-b3e96f32c3cf->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788330269.022815:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) cfe8163f-ff22-4eb0-b728-b3e96f32c3cf->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788330269.022819:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788330269.022822:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788330269.022982:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792429056:0@lo:400:kworker.0 00000400:00000100:0.0:1788330269.023043:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792429056 offset 0 length 224: 4 00000100:00100000:1.0:1788330269.531301:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330259/real 1788330259] req@ffff99eefd32ea00 x1875199792427776/t0(0) o250->MGC192.168.202.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788330269 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330269.531336:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99eefd32ea00 x1875199792427776/t0(0) o250->MGC192.168.202.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788330269 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788330269.531358:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eec9881800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330269.531385:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788330269.531389:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3645:1875199792427776:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1788330269.531488:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) cfe8163f-ff22-4eb0-b728-b3e96f32c3cf->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788330269.531493:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788330269.531496:0:37:0:(import.c:65:import_set_state_nolock()) ffff99eec9881800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788330269.531502:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.150@tcp: connect to NID 0@lo last attempt 463 00000100:00080000:0.0:1788330269.531509:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.150@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788330269.531515:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.150@tcp: import ffff99eec9881800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:0.0:1788330269.531553:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eefd32d180 x1875199792429184/t0(0) o250->MGC192.168.202.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788330269.531733:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3645:1875199792429184:0@lo:250:kworker.0 00000400:00000100:1.0:1788330269.531794:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875199792429184 offset 0 length 520: 4 00000100:00080000:0.0:1788330269.532045:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788330269.532050:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788330269.532186:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792429312:0@lo:400:kworker.0 00000400:00000100:2.0:1788330269.532217:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792429312 offset 0 length 224: 4 00010000:00010000:2.0:1788330269.723457:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330270.747721:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330271.772657:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330272.795929:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330273.819519:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788330274.716383:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) cfe8163f-ff22-4eb0-b728-b3e96f32c3cf->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788330274.716395:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) cfe8163f-ff22-4eb0-b728-b3e96f32c3cf->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788330274.716398:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788330274.716402:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788330274.716525:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330274.716541:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792429440:0@lo:400:kworker.0 00000400:00000100:0.0:1788330274.716610:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792429440 offset 0 length 224: 4 00010000:00010000:1.0:1788330274.844401:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330275.675410:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330265/real 1788330265] req@ffff99eefd32d880 x1875199792428928/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788330275 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330275.675447:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99eefd32d880 x1875199792428928/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788330275 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788330275.675469:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc5f36800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788330275.675492:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875199792428928:0@lo:39:umount.0 00000100:00080000:0.0:1788330275.675547:0:15516:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788330275.675552:0:15516:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788330275.675557:0:15516:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788330275.677068:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2000/0x8475908e9fd0ef8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0eff expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330275.677086:0:15516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2000/0x8475908e9fd0ef8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0eff expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330275.677093:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef58c2000/0x8475908e9fd0ef8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0eff expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330275.677099:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eef58c2000/0x8475908e9fd0ef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0eff expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330275.677147:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330275.677186:0:15516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd117c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1183 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330275.677193:0:15516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd117c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd1183 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330275.677199:0:15516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd117c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd1183 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330275.677205:0:15516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd117c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd1183 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330275.677236:0:15516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788330275.677241:0:15516:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788330275.677266:0:15516:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788330275.677271:0:15516:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788330275.677275:0:15516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788330275.677280:0:15516:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788330275.677285:0:15516:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff99eef6df19b8) has no exports 00000020:00080000:0.0:1788330275.677310:0:15516:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff99eef6df19b8) has no exports 00000020:01000000:0.0:1788330275.679060:0:15516:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99eefe62db40 - data ffff99eedfb2d5e8/ffff99eefe742000 00000020:01000000:0.0:1788330275.679253:0:15516:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99edc5de9420 - data ffff99eedf9e11b0/ffff99eefe827800 00010000:00010000:3.0:1788330275.679844:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330275.679854:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef58c2000/0x8475908e9fd0ef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0eff expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330275.679866:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef58c2000 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330275.679870:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2000/0x8475908e9fd0ef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0eff expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330275.679880:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef58c2000/0x8475908e9fd0ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd0eff expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330275.679921:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef58c2000/0x8475908e9fd0ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd0eff expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330275.679927:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788330275.679930:0:10341:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788330275.679933:0:10341:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788330275.679950:0:10341:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99eec9881800 00010000:00010000:3.0:1788330275.679953:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef58c2000/0x8475908e9fd0ef8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd0eff expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330275.679959:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef58c2000/0x8475908e9fd0ef8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd0eff expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330275.679970:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330275.679974:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd117c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd1183 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330275.679979:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef59cbe00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330275.679981:0:10341:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd117c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd1183 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330275.679987:0:10341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd117c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd1183 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330275.679992:0:10341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd117c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd1183 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330275.679996:0:10341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788330275.679999:0:10341:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788330275.680007:0:10341:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788330275.680012:0:10341:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99eec9881800 00010000:00010000:3.0:1788330275.680016:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd117c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd1183 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330275.680022:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef59cbe00/0x8475908e9fd117c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd1183 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330275.680030:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330275.680032:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330275.680034:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330275.680639:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788330275.691766:0:15516:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788330275.704861:0:15516:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0c4a 00000020:00000080:3.0:1788330275.704875:0:15516:0:(genops.c:885:class_export_put()) final put ffff99edc5c6b000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788330275.704899:0:15516:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99eefe782800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788330275.704903:0:15516:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eefe782800 2 00000020:01000004:3.0:1788330275.704907:0:15516:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99eefe782800 from lustre-OST0000 00000020:00000080:3.0:1788330275.704934:0:15516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330275.704943:0:15516:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788330275.704946:0:15516:0:(genops.c:885:class_export_put()) final put ffff99edc5c6f800/lustre-OST0000_UUID 00000020:00000080:3.0:1788330275.704948:0:15516:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc5c6f800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788330275.704955:0:15516:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788330275.705019:0:15516:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788330275.705023:0:15516:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788330275.705027:0:15516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788330275.705032:0:15516:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788330275.705040:0:15516:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff99edc5f30000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788330275.705045:0:15516:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff99eee76c3370) has exports, disconnecting them 00000020:00080000:3.0:1788330275.705049:0:15516:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff99edc5f30000), last request at 1788330018 00000020:00000080:3.0:1788330275.705053:0:15516:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0c74 00000020:00080000:3.0:1788330275.705064:0:15516:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99edc5f30000): rc 0 00000020:00000080:3.0:1788330275.705069:0:15516:0:(genops.c:885:class_export_put()) final put ffff99edc5f30000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788330275.705471:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc5c6b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788330275.705486:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc5f30000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788330275.709366:0:15516:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788330275.709386:0:15516:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788330275.709391:0:15516:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788330275.709423:0:15516:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788330275.709646:0:15516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788330275.709655:0:15516:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788330275.709661:0:15516:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788330275.709666:0:15516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788330275.709671:0:15516:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788330275.709678:0:15516:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff99eef59fd000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788330275.709685:0:15516:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff99eee76c19b8) has exports, disconnecting them 00000020:00080000:0.0:1788330275.709702:0:15516:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff99eef59fd000), last request at 1788330018 00000020:00000080:0.0:1788330275.709707:0:15516:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0c89 00000020:00080000:0.0:1788330275.709727:0:15516:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99eef59fd000): rc 0 00000020:00000080:0.0:1788330275.709731:0:15516:0:(genops.c:885:class_export_put()) final put ffff99eef59fd000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788330275.710490:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc5f37000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788330275.710500:0:36:0:(genops.c:885:class_export_put()) final put ffff99edc5f35800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788330275.710503:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc5f35800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788330275.710518:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788330275.710597:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef59fd000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788330275.710625:0:15516:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788330275.710638:0:15516:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788330275.710642:0:15516:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788330275.710646:0:15516:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788330275.710665:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc5f36800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788330275.710819:0:15516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788330275.710825:0:15516:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788330275.710828:0:15516:0:(genops.c:885:class_export_put()) final put ffff99eef59fe000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788330275.710830:0:15516:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef59fe000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788330275.710834:0:15516:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788330275.710859:0:15516:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eefe782800 1 00000020:00000080:1.0:1788330275.710864:0:15516:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0c12 00000020:00000080:1.0:1788330275.710869:0:15516:0:(genops.c:885:class_export_put()) final put ffff99eef58de800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788330275.710877:0:15516:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788330275.710884:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef58de800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788330275.710893:0:15516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788330275.710897:0:15516:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788330275.710900:0:15516:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff99eef6df0000) has no exports 00000020:00000080:1.0:1788330275.829665:0:15516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788330275.829683:0:15516:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788330275.829690:0:15516:0:(genops.c:885:class_export_put()) final put ffff99eefe783000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788330275.829696:0:15516:0:(genops.c:844:class_export_destroy()) destroying export ffff99eefe783000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788330275.829713:0:15516:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788330275.829864:0:15516:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99eefe787800 00000020:02000400:1.0:1788330275.829939:0:15516:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788330275.991197:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330277.020343:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330278.044054:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330279.076145:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1788330279.836897:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330263/real 1788330263] req@ffff99edc7e75180 x1875199792428544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788330279 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788330279.847920:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) cfe8163f-ff22-4eb0-b728-b3e96f32c3cf->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788330279.848103:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) cfe8163f-ff22-4eb0-b728-b3e96f32c3cf->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788330279.848108:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788330279.848113:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788330279.848257:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330279.848285:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792429568:0@lo:400:kworker.0 00000400:00000100:3.0:1788330279.848375:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792429568 offset 0 length 224: 4 00000100:00100000:1.0:1788330279.890473:0:3646:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff99edc7e75180 x1875199792428544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788330279 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788330279.890495:0:3646:0:(import.c:65:import_set_state_nolock()) ffff99edc655e800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788330279.890776:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788330279.905829:0:3646:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1788330279.906589:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) cfe8163f-ff22-4eb0-b728-b3e96f32c3cf->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788330279.906597:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) cfe8163f-ff22-4eb0-b728-b3e96f32c3cf->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788330279.906600:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788330279.906604:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788330279.906607:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788330279.906612:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788330279.906618:0:36:0:(import.c:65:import_set_state_nolock()) ffff99edc655e800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788330279.906629:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 245 00000100:00080000:0.0:1788330279.906643:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99edc655e800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:0.0:1788330279.906695:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eefd32e300 x1875199792429696/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788330279.906760:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792428544:0@lo:400:kworker.0 00000100:00100000:2.0:1788330279.906829:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875199792429696:0@lo:38:kworker.0 00000400:00000100:2.0:1788330279.906907:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199792429696 offset 0 length 520: 4 00010000:00010000:1.0:1788330280.091350:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788330280.203546:0:15718:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788330280.243220:0:15718:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788330280.243324:0:15718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765b000/0x8475908e9fd0ece lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ed5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330280.243345:0:15718:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765b000/0x8475908e9fd0ece lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0ed5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330280.243353:0:15718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765b000/0x8475908e9fd0ece lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0ed5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330280.243359:0:15718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99edc765b000/0x8475908e9fd0ece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0ed5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330280.243389:0:15718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788330280.243394:0:15718:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788330280.243427:0:15718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788330280.243441:0:15718:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99edc7e77480 x1875199792428416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788330283 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330280.243459:0:15718:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788330280.243466:0:15718:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788330280.243474:0:15718:0:(import.c:65:import_set_state_nolock()) ffff99edc5f36000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788330280.243479:0:15718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788330280.243482:0:15718:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99edc7e77480 x1875199792428416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788330283 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330280.243489:0:15718:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788330280.243493:0:15718:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00010000:00010000:2.0:1788330280.243838:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330280.243849:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99edc765b000/0x8475908e9fd0ece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0ed5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330280.243858:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765b000 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:2.0:1788330280.243862:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99edc765b000/0x8475908e9fd0ece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0ed5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330280.243871:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99edc765b000/0x8475908e9fd0ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd0ed5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330280.243895:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99edc765b000/0x8475908e9fd0ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd0ed5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330280.243903:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788330280.243906:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788330280.243908:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788330280.243940:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99eec9881800 00010000:00010000:2.0:1788330280.243945:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99edc765b000/0x8475908e9fd0ece lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd0ed5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330280.243952:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99edc765b000/0x8475908e9fd0ece lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd0ed5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330280.243965:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330280.243967:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330280.243969:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330280.244091:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875199792428416:0@lo:38:kworker.0 00000100:00080000:0.0:1788330280.245815:0:15718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788330280.245836:0:15718:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99edc75ff100 x1875199792428800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330281 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330280.245861:0:15718:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99edc7e76300 x1875199792429056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330285 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330280.245884:0:15718:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eefd32f480 x1875199792429312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330285 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330280.245903:0:15718:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99edc75fc000 x1875199792429440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330290 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330280.245911:0:15718:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99edc75ff800 x1875199792429568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330295 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330280.245918:0:15718:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eefd32e300 x1875199792429696/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788330289 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330280.245984:0:15718:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788330280.246028:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792429440:0@lo:400:kworker.0 00000100:00100000:0.0:1788330280.246038:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875199792429312:0@lo:400:kworker.0 00000100:00080000:0.0:1788330280.246081:0:15718:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788330280.246089:0:15718:0:(import.c:65:import_set_state_nolock()) ffff99edc655e800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788330280.246096:0:15718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788330280.246101:0:15718:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99edc75ff100 x1875199792428800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330281 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330280.246110:0:15718:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99edc7e76300 x1875199792429056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330285 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330280.246117:0:15718:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99edc75ff800 x1875199792429568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330295 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330280.246125:0:15718:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eefd32e300 x1875199792429696/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788330289 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330280.246132:0:15718:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788330280.246135:0:15718:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1788330280.246256:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875199792429696:0@lo:38:kworker.0 00000100:00100000:3.0:1788330280.247118:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792429568:0@lo:400:kworker.0 00000100:00100000:3.0:1788330280.247142:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792429056:0@lo:400:kworker.0 00000100:00100000:3.0:1788330280.247170:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792428800:0@lo:400:kworker.0 00010000:00010000:0.0:1788330280.248758:0:15718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765ae00/0x8475908e9fd0edc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd0ee3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330280.248782:0:15718:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765ae00/0x8475908e9fd0edc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd0ee3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330280.248791:0:15718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99edc765ae00/0x8475908e9fd0edc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0ee3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330280.248798:0:15718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99edc765ae00/0x8475908e9fd0edc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd0ee3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330280.248826:0:15718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330280.248836:0:15718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd116e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1175 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330280.248843:0:15718:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd116e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd1175 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330280.248849:0:15718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd116e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd1175 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330280.248856:0:15718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd116e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8475908e9fd1175 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330280.248882:0:15718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788330280.248887:0:15718:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788330280.248918:0:15718:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788330280.248936:0:15718:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788330280.248942:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788330280.248949:0:15718:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788330280.248969:0:15718:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff99edc67d8000) has no exports 00000020:00080000:0.0:1788330280.249001:0:15718:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff99edc67d8000) has no exports 00010000:00010000:3.0:1788330280.249979:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330280.249993:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99edc765ae00/0x8475908e9fd0edc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0ee3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330280.250005:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99edc765ae00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330280.250010:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99edc765ae00/0x8475908e9fd0edc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd0ee3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330280.250021:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99edc765ae00/0x8475908e9fd0edc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd0ee3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330280.250030:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99edc765ae00/0x8475908e9fd0edc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd0ee3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330280.250053:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788330280.250056:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788330280.250059:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788330280.250084:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99eec9881800 00010000:00010000:3.0:1788330280.250089:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99edc765ae00/0x8475908e9fd0edc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd0ee3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330280.250097:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99edc765ae00/0x8475908e9fd0edc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd0ee3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330280.250114:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330280.250119:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd116e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd1175 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330280.250125:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78c00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330280.250128:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd116e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8475908e9fd1175 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330280.250135:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd116e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd1175 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330280.250143:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd116e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd1175 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330280.250175:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788330280.250177:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788330280.250179:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788330280.250185:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99eec9881800 00010000:00010000:3.0:1788330280.250188:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd116e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd1175 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330280.250204:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd116e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd1175 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330280.250219:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330280.250221:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330280.250224:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330280.250524:0:10341:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788330280.252846:0:15718:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99eecaeb4d20 - data ffff99edc58506c0/ffff99edc76c1400 00000020:01000000:0.0:1788330280.253334:0:15718:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99eefe62d780 - data ffff99eedfa711b0/ffff99eef59f4c00 00100000:10000000:0.0:1788330280.268373:0:15718:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788330280.278707:0:15718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0d70 00000020:00000080:1.0:1788330280.278727:0:15718:0:(genops.c:885:class_export_put()) final put ffff99edc67ed000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788330280.278746:0:15718:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99eef6de3800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788330280.278752:0:15718:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eef6de3800 2 00000020:01000004:1.0:1788330280.278756:0:15718:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99eef6de3800 from lustre-OST0001 00000020:00000080:1.0:1788330280.278795:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788330280.278810:0:15718:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788330280.278814:0:15718:0:(genops.c:885:class_export_put()) final put ffff99edc65ed000/lustre-OST0001_UUID 00000020:00000080:1.0:1788330280.278818:0:15718:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc65ed000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788330280.278828:0:15718:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788330280.279033:0:15718:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import cfe8163f-ff22-4eb0-b728-b3e96f32c3cf->MGS 00010000:00010000:1.0:1788330280.279056:0:15718:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eeef91bc00/0x8475908e9fd0ac9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd0ad0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788330280.279073:0:15718:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eeef91bc00/0x8475908e9fd0ac9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd0ad0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330280.279082:0:15718:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788330280.279084:0:15718:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788330280.279089:0:15718:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788330280.279113:0:15718:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99eec9881800 00010000:00010000:1.0:1788330280.279118:0:15718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eeef91bc00/0x8475908e9fd0ac9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd0ad0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330280.279138:0:15718:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd0f3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8475908e9fd0f45 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788330280.279145:0:15718:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd0f3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8475908e9fd0f45 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330280.279188:0:15718:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788330280.279190:0:15718:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788330280.279192:0:15718:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788330280.279204:0:15718:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99eec9881800 00010000:00010000:1.0:1788330280.279207:0:15718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd0f3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8475908e9fd0f45 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788330280.279229:0:15718:0:(import.c:65:import_set_state_nolock()) ffff99eec9881800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788330280.279234:0:15718:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788330280.279237:0:15718:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788330280.279239:0:15718:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788330280.279243:0:15718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788330280.279259:0:15718:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99eefd32d180 x1875199792429184/t0(0) o250->MGC192.168.202.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788330284 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788330280.279279:0:15718:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788330280.279282:0:15718:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000020:00000080:3.0:1788330280.279373:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc67ed000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1788330280.284766:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cfe8163f-ff22-4eb0-b728-b3e96f32c3cf:3645:1875199792429184:0@lo:250:kworker.0 10000000:01000000:1.0:1788330280.285721:0:15718:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788330280.285745:0:15718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd09c6 00000020:00000080:1.0:1788330280.285760:0:15718:0:(genops.c:885:class_export_put()) final put ffff99eee7579800/cfe8163f-ff22-4eb0-b728-b3e96f32c3cf 00000020:01000000:1.0:1788330280.285784:0:15718:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.150@tcp (flags='') 00000020:00000080:1.0:1788330280.285793:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788330280.285807:0:15718:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.150@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788330280.285812:0:15718:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff99eee7570000) has no exports 00000020:00000080:3.0:1788330280.285879:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eee7579800/cfe8163f-ff22-4eb0-b728-b3e96f32c3cf for MGC192.168.202.150@tcp 10000000:01000000:2.0:1788330280.285934:0:6519:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788330280.286146:0:15718:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.150@tcp: client import never connected 00000100:00080000:1.0:1788330280.286231:0:15718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788330280.286236:0:15718:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788330280.286239:0:15718:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788330280.286242:0:15718:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788330280.286293:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788330280.286302:0:15718:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.150@tcp (uuid cfe8163f-ff22-4eb0-b728-b3e96f32c3cf) 00000020:01000000:1.0:1788330280.286309:0:15718:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788330280.286324:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788330280.286328:0:15718:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788330280.286335:0:15718:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff99eef6dcd800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788330280.286341:0:15718:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff99eef6df4d28) has exports, disconnecting them 00000020:00080000:1.0:1788330280.286346:0:15718:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff99eef6dcd800), last request at 1788330041 00000020:00000080:1.0:1788330280.286351:0:15718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0d9a 00000020:00080000:1.0:1788330280.286363:0:15718:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99eef6dcd800): rc 0 00000020:00000080:1.0:1788330280.286367:0:15718:0:(genops.c:885:class_export_put()) final put ffff99eef6dcd800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788330280.286640:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99eec9881800 for MGC192.168.202.150@tcp 00000020:00000080:3.0:1788330280.286648:0:36:0:(genops.c:885:class_export_put()) final put ffff99eec9883800/cfe8163f-ff22-4eb0-b728-b3e96f32c3cf 00000020:00000080:3.0:1788330280.286651:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eec9883800/cfe8163f-ff22-4eb0-b728-b3e96f32c3cf for MGC192.168.202.150@tcp 00000020:01000000:3.0:1788330280.286658:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.150@tcp (cfe8163f-ff22-4eb0-b728-b3e96f32c3cf) 00000020:00000080:3.0:1788330280.287263:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef6dcd800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788330280.290226:0:15718:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788330280.290239:0:15718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788330280.290244:0:15718:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788330280.290255:0:15718:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788330280.290521:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788330280.290539:0:15718:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788330280.290549:0:15718:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788330280.290555:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330280.290583:0:15718:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788330280.290594:0:15718:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff99eedfe68800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788330280.290602:0:15718:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff99eeffc4cd28) has exports, disconnecting them 00000020:00080000:2.0:1788330280.290607:0:15718:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff99eedfe68800), last request at 1788330041 00000020:00000080:2.0:1788330280.290612:0:15718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0daf 00000020:00080000:2.0:1788330280.290633:0:15718:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99eedfe68800): rc 0 00000020:00000080:2.0:1788330280.290640:0:15718:0:(genops.c:885:class_export_put()) final put ffff99eedfe68800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788330280.291066:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc5f36000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788330280.291076:0:36:0:(genops.c:885:class_export_put()) final put ffff99eef6dca000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788330280.291079:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef6dca000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788330280.291088:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788330280.291189:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99eedfe68800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788330280.293290:0:15718:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788330280.293301:0:15718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788330280.293306:0:15718:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788330280.293316:0:15718:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788330280.293386:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:2.0:1788330280.296275:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99edc655e800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788330280.298214:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788330280.298396:0:10341:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788330280.300272:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff99eec4c03800:6506] 1 exiting: rc = 0 00000100:00100000:2.0:1788330280.302273:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff99eec4c03000:6505] 0 exiting: rc = 1 00000100:00100000:2.0:1788330280.302407:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.305784:0:8454:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff99edc5c35800:8454] 3 exiting: rc = 0 00000100:00100000:1.0:1788330280.305927:0:6509:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff99eef4067c00:6509] 2 exiting: rc = 0 00000100:00100000:2.0:1788330280.306242:0:6507:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff99eee767ec00:6507] 0 exiting: rc = 1 00000100:00100000:1.0:1788330280.306443:0:13195:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff99eec5ce9800:13195] 4 exiting: rc = 0 00000100:00100000:1.0:1788330280.308296:0:6508:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff99eef4066c00:6508] 1 exiting: rc = 0 00000100:00100000:2.0:1788330280.308479:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308491:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308499:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308521:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308586:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308594:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308602:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308610:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308617:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308626:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308632:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308639:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308662:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308670:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308679:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308687:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308693:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308701:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308709:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308717:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308724:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308732:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308738:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308745:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308751:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308757:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308763:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308768:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308774:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308779:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308785:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308792:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308800:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308806:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308812:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308818:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308824:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308830:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308835:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308841:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308846:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308852:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308857:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308862:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308868:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308874:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308880:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308896:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308902:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308907:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308913:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308918:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308924:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308931:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308936:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308943:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308948:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308953:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308959:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308965:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308970:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308976:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308982:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.308989:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788330280.310704:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788330280.310722:0:15718:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788330280.310731:0:15718:0:(genops.c:885:class_export_put()) final put ffff99eef6dcb800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788330280.310737:0:15718:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef6dcb800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788330280.310745:0:15718:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788330280.310822:0:15718:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eef6de3800 1 00000020:00000080:2.0:1788330280.310830:0:15718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8475908e9fd0d3f 00000020:00000080:2.0:1788330280.310838:0:15718:0:(genops.c:885:class_export_put()) final put ffff99edc655f000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788330280.310862:0:15718:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788330280.310867:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330280.310873:0:15718:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788330280.310877:0:15718:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff99eef5833370) has no exports 00000020:00000080:1.0:1788330280.312815:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99edc655f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788330280.341395:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330280.341419:0:15718:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788330280.341427:0:15718:0:(genops.c:885:class_export_put()) final put ffff99eef6de2800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788330280.341434:0:15718:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef6de2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788330280.341443:0:15718:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788330280.342112:0:15718:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99eef6de5800 00000020:01000000:3.0:1788330280.342374:0:15718:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788330280.342379:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788330280.342386:0:15718:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788330280.342391:0:15718:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff99eef6df3370) has no exports 00000020:00000080:3.0:1788330280.342443:0:15718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330280.342451:0:15718:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788330280.342455:0:15718:0:(genops.c:885:class_export_put()) final put ffff99eef58d8800/OSS_uuid 00000020:00000080:3.0:1788330280.342458:0:15718:0:(genops.c:844:class_export_destroy()) destroying export ffff99eef58d8800/OSS_uuid for OSS 00000020:01000000:3.0:1788330280.342463:0:15718:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788330280.343071:0:13409:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff99edc5c5a000:13409] 4 exiting: rc = 0 00000100:00100000:1.0:1788330280.343716:0:8632:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff99eef6e57a00:8632] 3 exiting: rc = 0 00000100:00100000:1.0:1788330280.343813:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff99eee7505800:8437] 0 exiting: rc = 1 00000100:00080000:0.0:1788330280.344014:0:6518:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788330280.344138:0:13829:0:(service.c:3183:ptlrpc_main()) ll_ost00_005: service thread [ffff99eee7324200:13829] 5 exiting: rc = 0 00000100:00100000:3.0:1788330280.345298:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff99eefe695400:8440] 2 exiting: rc = 0 00000100:00100000:3.0:1788330280.345384:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff99eef80abc00:8439] 1 exiting: rc = 0 00000100:00100000:0.0:1788330280.346046:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346057:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346071:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346079:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346086:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346093:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346099:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346105:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346111:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346117:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346122:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346128:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346134:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346139:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346145:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346178:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346185:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346191:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346196:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346200:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346205:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346210:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346215:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346219:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346224:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346230:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346237:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346257:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346261:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346266:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346272:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346276:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346282:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346289:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346295:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346301:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346306:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346312:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346318:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346323:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346329:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346335:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346340:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346347:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346354:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346359:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346365:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346371:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346377:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346383:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346388:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346393:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346397:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346402:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346407:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346420:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346426:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346431:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346435:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346440:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346445:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346450:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346460:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.346469:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.351096:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff99eef708da00:8441] 0 exiting: rc = 1 00000100:00100000:0.0:1788330280.352302:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff99eefe4e5000:8442] 1 exiting: rc = 0 00000100:00100000:0.0:1788330280.355407:0:11624:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff99edc72e3800:11624] 2 exiting: rc = 0 00000100:00100000:2.0:1788330280.355688:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355701:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355709:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355729:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355735:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355741:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355747:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355753:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355758:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355764:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355768:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355775:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355779:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355783:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355787:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355791:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355795:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355799:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355803:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355806:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355809:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355813:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355816:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355819:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355822:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355826:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355828:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355831:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355834:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355836:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355839:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355842:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355849:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355853:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355856:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355860:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355863:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355867:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355875:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355879:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355883:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355890:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355894:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355899:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355903:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355907:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355911:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355914:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355918:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355921:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355926:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355932:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355936:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355942:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355954:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355960:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355966:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355971:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355976:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355981:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355986:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355991:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.355997:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.356009:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.358051:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff99eefe774a00:8445] 2 exiting: rc = 0 00000100:00100000:1.0:1788330280.358689:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff99eefe775200:8444] 1 exiting: rc = 0 00000100:00100000:1.0:1788330280.358868:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff99eef80aa600:8443] 0 exiting: rc = 1 00000100:00100000:0.0:1788330280.359001:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359010:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359017:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359023:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359031:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359037:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359049:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359055:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359060:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359064:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359069:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359074:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359078:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359083:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359087:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359106:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359112:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359116:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359121:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359126:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359130:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359134:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359138:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359143:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359169:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359175:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359179:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359184:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359189:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359194:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359198:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359215:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359219:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359223:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359227:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359232:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359236:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359240:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359243:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359248:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359251:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359255:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359259:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359272:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359276:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359281:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359285:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359290:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359295:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359300:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359307:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359311:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359317:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359321:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359330:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359336:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359348:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359353:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359358:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359363:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359368:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359373:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359377:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330280.359387:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330280.370212:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff99eef708c600:8446] 0 exiting: rc = 1 00000100:00100000:2.0:1788330280.370373:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff99eef708d400:8447] 1 exiting: rc = 0 00000100:00100000:1.0:1788330280.370776:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370785:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370792:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370798:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370805:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370811:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370818:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370824:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370830:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370835:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370841:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370847:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370853:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370875:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370882:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370889:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370896:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370901:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370907:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370913:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370920:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370942:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370948:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370954:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370959:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370964:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370969:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370975:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370980:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370985:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370991:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.370998:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371003:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371008:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371015:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371021:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371028:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371034:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371040:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371047:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371053:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371058:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371064:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371070:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371075:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371081:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371087:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371092:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371106:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371113:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371118:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371124:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371129:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371134:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371140:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371146:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371182:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371188:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371193:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371197:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371201:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371205:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371209:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.371220:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330280.372471:0:8449:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff99eefe772000:8449] 1 exiting: rc = 0 00000100:00100000:0.0:1788330280.372745:0:8448:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff99eefe485200:8448] 0 exiting: rc = 1 00000100:00100000:1.0:1788330280.372947:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.372957:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.372964:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.372972:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.372980:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.373009:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.373017:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.373024:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.373030:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.373036:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.373042:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.373048:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.373055:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.373062:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.373069:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.373076:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.373083:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.373107:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.373117:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.373138:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.373145:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374098:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374110:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374116:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374123:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374130:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374137:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374144:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374175:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374206:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374214:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374221:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374230:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374237:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374244:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374252:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374259:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374267:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374274:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374281:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374290:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374312:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374320:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374329:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374338:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374345:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374352:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374360:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374367:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374374:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374381:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374388:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374394:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374416:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374433:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374440:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374447:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374454:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374461:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374468:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374475:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374483:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374489:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330280.374841:0:15718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788330280.397009:0:15718:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788330302.837001:0:16483:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788330315.087643:0:17082:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788330315.087661:0:17082:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788330315.087663:0:17082:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788330315.087798:0:17082:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99edc7d05800 00000020:01000004:0.0:1788330315.087821:0:17082:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788330315.087831:0:17082:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788330315.087851:0:17082:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99eef5833370) 00000020:00000080:0.0:1788330315.087870:0:17082:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788330315.190625:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788330315.192842:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788330315.202553:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788330315.202974:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788330315.203263:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788330315.203585:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788330315.204047:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788330315.204990:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788330315.205459:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788330315.205782:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788330315.206081:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788330315.206475:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788330315.206746:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788330315.207414:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788330315.208054:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788330315.210596:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788330315.215596:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788330315.216680:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788330315.217711:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788330315.219059:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788330315.219880:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788330315.221503:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788330315.223141:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788330315.226312:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788330315.227614:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788330315.229415:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788330315.230068:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788330315.230586:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788330315.230855:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788330315.232021:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788330315.232548:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788330315.238986:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788330315.239554:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788330315.239953:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788330315.240461:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788330315.240825:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788330315.241075:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788330315.241744:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788330315.242008:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788330315.242389:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788330315.242645:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788330315.242830:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788330315.243456:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788330315.244576:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788330315.244973:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788330315.245223:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788330315.247829:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788330315.250930:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788330315.251640:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788330315.251870:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788330315.252481:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788330315.252771:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788330315.252969:0:17082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:2.0:1788330315.256796:0:17082:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788330315.257085:0:17082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788330315.257095:0:17082:0:(osd_handler.c:8927:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788330315.257113:0:17082:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd1f83 00000020:01000004:2.0:1788330315.257122:0:17082:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788330315.257144:0:17082:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788330315.257176:0:17082:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99edc7d05800 from MGS 00000020:01000004:2.0:1788330315.257182:0:17082:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788330315.257208:0:17082:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99eef6df3370) 00000020:00000080:2.0:1788330315.257223:0:17082:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788330315.257317:0:17082:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99edc7d05800 from MGS, refs=2 00080000:01000000:2.0:1788330315.257323:0:17082:0:(osd_handler.c:8927:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788330315.257329:0:17082:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd1f91 00000100:00100000:2.0:1788330315.257440:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788330315.257609:0:17082:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788330315.257616:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788330315.266877:0:17082:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788330315.266985:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788330315.269592:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788330315.269821:0:17082:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788330315.269828:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788330315.270667:0:17082:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788330315.270676:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788330315.279045:0:17082:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788330315.279076:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788330315.285526:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330315.285535:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330315.285538:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330315.286088:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330315.286091:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330315.286093:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330315.286814:0:17082:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788330315.291217:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788330315.305694:0:17082:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788330315.310003:0:17082:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788330315.310063:0:17082:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 10000000:01000000:2.0:1788330315.311004:0:17094:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788330315.313436:0:17082:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788330315.315452:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788330315.316136:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788330315.316144:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788330315.320695:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788330315.320718:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788330315.324624:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788330315.324648:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788330315.325623:0:17082:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788330315.325658:0:17082:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.150@tcp' 00000020:01000004:1.0:1788330315.325660:0:17082:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788330315.325704:0:17082:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.150@tcp (typ=mgc) 00000020:00000080:1.0:1788330315.325725:0:17082:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.150@tcp (ffff99edc67d8000) 00000020:00000080:1.0:1788330315.325747:0:17082:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788330315.325855:0:17082:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc67e9000@MGC192.168.202.150@tcp: add connection 192.168.202.150@tcp at head 00010000:00010000:1.0:1788330315.326017:0:17082:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.150@tcp-0 is initialized 00000040:01000000:1.0:1788330315.326026:0:17082:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788330315.331661:0:17099:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788330315.335749:0:17101:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788330315.335861:0:17082:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.150@tcp (uuid 6efb806c-ba9f-4d20-bba3-c0a9c1d82585) 00000020:00000080:2.0:1788330315.335903:0:17082:0:(genops.c:1385:class_connect()) connect: client 6efb806c-ba9f-4d20-bba3-c0a9c1d82585, cookie 0x8475908e9fd1f9f 00000100:00080000:2.0:1788330315.335920:0:17082:0:(import.c:510:import_select_connection()) MGC192.168.202.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788330315.335928:0:17082:0:(import.c:624:import_select_connection()) MGC192.168.202.150@tcp: import ffff99edc67e9000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330315.335973:0:17082:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc5eebb80 x1875199792429824/t0(0) o250->MGC192.168.202.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788330315.336006:0:17082:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6efb806c-ba9f-4d20-bba3-c0a9c1d82585->MGS 00000020:01000004:2.0:1788330315.336029:0:17082:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788330315.336035:0:17082:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788330315.336054:0:17082:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff99eef6df4d28) 00000020:00000080:2.0:1788330315.336070:0:17082:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788330315.336143:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3645:1875199792429824:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788330315.336285:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330315.345531:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792429824 00000100:00100000:1.0:1788330315.345991:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792429824 00000100:00100000:1.0:1788330315.346749:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788330315.346762:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3645:x1875199792429824:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788330315.346802:0:17095:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6efb806c-ba9f-4d20-bba3-c0a9c1d82585@0@lo t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:1.0:1788330315.346838:0:17095:0:(genops.c:1385:class_connect()) connect: client 6efb806c-ba9f-4d20-bba3-c0a9c1d82585, cookie 0x8475908e9fd1fad 00000100:00080000:1.0:1788330315.347035:0:17095:0:(import.c:65:import_set_state_nolock()) ffff99edc67ea800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788330315.347178:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+5:3645:x1875199792429824:12345-0@lo:250:mount.lustre.0 Request processed in 418us (10893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330315.347187:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788330315.350091:0:3645:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788330315.350114:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.150@tcp: connect to target with instance 0 00000100:00080000:1.0:1788330315.350125:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788330315.350132:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788330315.350138:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc67e9000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788330315.350142:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788330315.350167:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788330315.350178:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3645:1875199792429824:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788330315.362756:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788330315.363119:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788330315.363127:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788330315.364944:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788330315.364961:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788330315.365762:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788330315.365779:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788330315.367393:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788330315.367715:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788330315.367722:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788330315.368716:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788330315.368726:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788330315.431842:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788330315.432109:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788330315.432118:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788330315.434009:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788330315.434025:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788330315.435672:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788330315.435911:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788330315.435919:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788330315.437102:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788330315.437117:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788330315.438905:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788330315.439129:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788330315.439137:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788330315.440279:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788330315.440291:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788330315.441813:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788330315.442056:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788330315.442063:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788330315.444653:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788330315.444674:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788330315.479815:0:17082:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788330315.480309:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788330315.480319:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788330315.483551:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788330315.483578:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788330315.485269:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788330315.485286:0:17082:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788330315.486703:0:17082:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788330315.486748:0:17082:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788330315.486756:0:17082:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788330315.486912:0:17082:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788330315.486967:0:17082:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.150@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788330315.486973:0:17082:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788330315.486975:0:17082:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788330315.486976:0:17082:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788330315.486978:0:17082:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788330315.486979:0:17082:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788330315.486980:0:17082:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788330315.486982:0:17082:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788330315.486984:0:17082:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788330315.486987:0:17082:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788330315.486989:0:17082:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788330315.486992:0:17082:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788330315.486995:0:17082:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788330315.486996:0:17082:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788330315.486997:0:17082:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788330315.486998:0:17082:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788330315.486999:0:17082:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788330315.487000:0:17082:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788330315.487002:0:17082:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788330315.487003:0:17082:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788330315.487004:0:17082:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788330315.487005:0:17082:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788330315.487046:0:17082:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788330315.487074:0:17082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792429952:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788330315.487751:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330315.487827:0:17082:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6e9cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788330315.487905:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792429952 00000100:00100000:1.0:1788330315.487916:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792429952 00000100:00100000:1.0:1788330315.488023:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788330315.488036:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+5:17082:x1875199792429952:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788330315.488097:0:17098:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788330315.488101:0:17098:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788330315.488104:0:17098:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788330315.489922:0:17119:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788330315.491689:0:17098:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1788330315.493772:0:17120:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788330315.493786:0:17120:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788330315.493790:0:17120:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788330315.493793:0:17120:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788330315.494355:0:17120:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788330315.494871:0:17098:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788330315.494886:0:17098:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788330315.498551:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+5:17082:x1875199792429952:12345-0@lo:253:mount.lustre.0 Request processed in 10505us (10788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330315.498577:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788330315.498766:0:17082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792429952:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788330315.498788:0:17082:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788330315.498792:0:17082:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788330315.498794:0:17082:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788330315.498796:0:17082:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788330315.498797:0:17082:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788330315.498799:0:17082:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788330315.498800:0:17082:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788330315.498802:0:17082:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788330315.498803:0:17082:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788330315.498805:0:17082:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788330315.498807:0:17082:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788330315.498835:0:17082:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99edc7d05800 from lustre-MDT0000 10000000:01000000:2.0:1788330315.498876:0:17082:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788330315.498880:0:17082:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788330315.498885:0:17082:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99edc67d8000 10000000:01000000:2.0:1788330315.498890:0:17082:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788330315.498899:0:17082:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99edc67d8000 from 1 10000000:01000000:2.0:1788330315.498903:0:17082:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788330315.498953:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd1fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.498965:0:17082:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd1fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.498977:0:17082:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd1fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330315.499018:0:17082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792430080:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788330315.499066:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330315.499117:0:17082:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef6e9c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788330315.499361:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792430080 00000100:00100000:0.0:1788330315.499370:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792430080 00000100:00100000:0.0:1788330315.499603:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788330315.499615:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+5:17082:x1875199792430080:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330315.499632:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330315.499650:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec1326400/0x8475908e9fd1fbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd1fb4 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330315.499679:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec1326400/0x8475908e9fd1fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd1fb4 expref: 6 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330315.499701:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec1326400/0x8475908e9fd1fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd1fb4 expref: 6 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330315.499712:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326400, rc 0) 00000100:00100000:0.0:1788330315.499775:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+6:17082:x1875199792430080:12345-0@lo:101:mount.lustre.0 Request processed in 162us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330315.499782:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788330315.500015:0:17082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792430080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330315.500033:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd1fb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1fbb expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.500043:0:17082:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd1fb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd1fbb expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330315.500124:0:17082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792430208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330315.500282:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330315.500318:0:17082:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3717780 going to sleep for 11 seconds 00000100:00100000:1.0:1788330315.500390:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792430208 00000100:00100000:1.0:1788330315.500396:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792430208 00000100:00100000:1.0:1788330315.500623:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788330315.500634:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+6:17082:x1875199792430208:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330315.500797:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+6:17082:x1875199792430208:12345-0@lo:501:mount.lustre.0 Request processed in 165us (514us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788330315.500805:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788330315.500916:0:17082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792430208:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788330315.500960:0:17082:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788330315.501020:0:17082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd1fb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1fbb expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.501031:0:17082:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd1fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1fbb expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330315.501043:0:17082:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99edc7d05800 10000000:01000000:3.0:1788330315.501048:0:17082:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788330315.501054:0:17082:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99edc7d05800 10000000:01000000:3.0:1788330315.501056:0:17082:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788330315.501060:0:17082:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99edc7d05800 from 1 10000000:01000000:3.0:1788330315.501063:0:17082:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788330315.501092:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147a600/0x8475908e9fd1fc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.501102:0:17082:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147a600/0x8475908e9fd1fc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.501110:0:17082:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147a600/0x8475908e9fd1fc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330315.501129:0:17082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792430336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788330315.501212:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330315.501231:0:17082:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3717780 going to sleep for 11 seconds 00000100:00100000:2.0:1788330315.501359:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792430336 00000100:00100000:2.0:1788330315.501366:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792430336 00000100:00100000:2.0:1788330315.501411:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788330315.501428:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+6:17082:x1875199792430336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788330315.501446:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330315.501463:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec9039a00/0x8475908e9fd1fc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd1fc2 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.501483:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9039a00/0x8475908e9fd1fc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd1fc2 expref: 7 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.501494:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec9039a00/0x8475908e9fd1fc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd1fc2 expref: 7 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.501503:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039a00, rc 0) 00000100:00100000:2.0:1788330315.501608:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+7:17082:x1875199792430336:12345-0@lo:101:mount.lustre.0 Request processed in 179us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330315.501616:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788330315.502033:0:17082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792430336:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330315.502051:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147a600/0x8475908e9fd1fc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1fc9 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330315.502061:0:17082:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147a600/0x8475908e9fd1fc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd1fc9 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330315.502078:0:17082:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788330315.502133:0:17082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147a600/0x8475908e9fd1fc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1fc9 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330315.502142:0:17082:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147a600/0x8475908e9fd1fc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1fc9 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330315.502180:0:17082:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788330315.502187:0:17082:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788330315.502203:0:17082:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99edc7d05800 10000000:01000000:0.0:1788330315.502207:0:17082:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788330315.502211:0:17082:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788330315.502213:0:17082:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788330315.502253:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1327200/0x8475908e9fd1fd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330315.502262:0:17082:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec1327200/0x8475908e9fd1fd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330315.502270:0:17082:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec1327200/0x8475908e9fd1fd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330315.502289:0:17082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792430464:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788330315.502333:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330315.502374:0:17082:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eecad27b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788330315.502462:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792430464 00000100:00100000:3.0:1788330315.502468:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792430464 00000100:00100000:3.0:1788330315.502509:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788330315.502519:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+7:17082:x1875199792430464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330315.502549:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330315.502563:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec147a400/0x8475908e9fd1fd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd1fd0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.502583:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec147a400/0x8475908e9fd1fd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd1fd0 expref: 8 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.502592:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec147a400/0x8475908e9fd1fd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd1fd0 expref: 8 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.502600:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147a400, rc 0) 00000100:00100000:3.0:1788330315.502649:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+8:17082:x1875199792430464:12345-0@lo:101:mount.lustre.0 Request processed in 131us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330315.502656:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788330315.502748:0:17082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792430464:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330315.502761:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec1327200/0x8475908e9fd1fd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1fd7 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330315.502770:0:17082:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec1327200/0x8475908e9fd1fd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd1fd7 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330315.502852:0:17082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792430592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330315.502887:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330315.502916:0:17082:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eecad27b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788330315.503165:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792430592 00000100:00100000:3.0:1788330315.503170:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792430592 00000100:00100000:3.0:1788330315.503215:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788330315.503223:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+8:17082:x1875199792430592:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330315.503390:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+9:17082:x1875199792430592:12345-0@lo:501:mount.lustre.0 Request processed in 167us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330315.503398:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788330315.503637:0:17082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792430592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330315.503680:0:17082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792430720:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330315.503725:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330315.503755:0:17082:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eecad27b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330315.503847:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792430720 00000100:00100000:2.0:1788330315.503852:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792430720 00000100:00100000:2.0:1788330315.503879:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788330315.503887:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+9:17082:x1875199792430720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788330315.504806:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+9:17082:x1875199792430720:12345-0@lo:503:mount.lustre.0 Request processed in 913us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330315.504829:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788330315.504988:0:17082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792430720:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330315.507323:0:17121:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17121:1875199792430848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788330315.507609:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330315.507800:0:17121:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10a5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330315.507922:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792430848 00000100:00100000:2.0:1788330315.507933:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792430848 00000100:00100000:2.0:1788330315.507989:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788330315.508001:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+9:17121:x1875199792430848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330315.508979:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+9:17121:x1875199792430848:12345-0@lo:502:llog_process_th.0 Request processed in 973us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330315.508993:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788330315.509512:0:17121:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17121:1875199792430848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788330315.509605:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330315.509625:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330315.509627:0:17121:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788330315.509632:0:17121:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788330315.509634:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788330315.509650:0:17121:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99edc67db370) 00000020:00000080:1.0:1788330315.509670:0:17121:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788330315.509674:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788330315.509782:0:17121:0:(osd_handler.c:8927:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788330315.509792:0:17121:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd1fe5 00000020:00000080:1.0:1788330315.510038:0:17121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788330315.510045:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330315.510049:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330315.510050:0:17121:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788330315.510053:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330315.510057:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330315.510058:0:17121:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788330315.510061:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788330315.510069:0:17121:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99edc67d99b8) 00000020:00000080:1.0:1788330315.510078:0:17121:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788330315.510082:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788330315.510084:0:17121:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788330315.510087:0:17121:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788330315.510094:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788330315.510141:0:17121:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99edc7d05800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788330315.510180:0:17121:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99edc67dcd28) 00000020:00000080:1.0:1788330315.510186:0:17121:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788330315.510333:0:17121:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788330315.510338:0:17121:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd1ffa 00000020:00000080:1.0:1788330315.510407:0:17121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788330315.510516:0:17121:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788330315.510569:0:17121:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8475908e9fd2001 00080000:01000000:1.0:1788330315.510575:0:17121:0:(osd_handler.c:8927:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788330315.510578:0:17121:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd2008 00010000:00010000:3.0:1788330315.597017:0:17121:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788330315.599936:0:17121:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:2.0:1788330315.603378:0:17121:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788330315.605016:0:17121:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99eef6df0000) 00000020:00000080:2.0:1788330315.605047:0:17121:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788330315.606021:0:17121:0:(osd_handler.c:8927:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788330315.606037:0:17121:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd2016 00000020:00000080:0.0:1788330315.612370:0:17121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788330315.618434:0:17121:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8475908e9fd201d 00000020:00000080:0.0:1788330315.619462:0:17121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788330315.619483:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330315.619543:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330315.619557:0:17121:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788330315.619562:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788330315.619566:0:17121:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1788330315.619568:0:17121:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788330315.619570:0:17121:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788330315.619572:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788330315.619575:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330315.619577:0:17121:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788330315.619580:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330315.619585:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330315.619587:0:17121:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788330315.619591:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788330315.619653:0:17121:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788330315.619674:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330315.619678:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330315.619679:0:17121:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788330315.619682:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330315.619685:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330315.619687:0:17121:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788330315.619689:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788330315.619696:0:17121:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:00000080:1.0:1788330315.619736:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788330315.619759:0:17121:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99eefd333370) 00000020:00000080:1.0:1788330315.619780:0:17121:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788330315.619786:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788330315.619859:0:17121:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788330315.619867:0:17121:0:(osd_handler.c:8927:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788330315.619875:0:17121:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd202b 00010000:00080000:1.0:1788330315.619932:0:17121:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc759f800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.150@tcp at head 00010000:00010000:1.0:1788330315.622657:0:17121:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788330315.623825:0:17121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788330315.623848:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788330315.623911:0:17121:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788330315.623940:0:17121:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd2032 00000100:00080000:2.0:1788330315.623954:0:17121:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788330315.623963:0:17121:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99edc759f800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330315.624016:0:17121:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc5ee8e00 x1875199792430976/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788330315.624538:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792430976:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788330315.624641:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788330315.624741:0:17121:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788330315.624852:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330315.624858:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330315.624860:0:17121:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788330315.624863:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788330315.624874:0:17121:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1788330315.624876:0:17121:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788330315.624877:0:17121:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788330315.624880:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788330315.624883:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330315.624885:0:17121:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788330315.624888:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788330315.624894:0:17121:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788330315.624898:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330315.624900:0:17121:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788330315.624903:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788330315.624907:0:17121:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:01000000:2.0:1788330315.624936:0:17121:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788330315.624939:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788330315.624958:0:17121:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99eef6df19b8) 00000020:00000080:2.0:1788330315.624976:0:17121:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788330315.624981:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788330315.625072:0:17121:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788330315.625079:0:17121:0:(osd_handler.c:8927:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788330315.625087:0:17121:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd2040 00010000:00080000:2.0:1788330315.625125:0:17121:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99eee7217000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.150@tcp at head 00010000:00010000:2.0:1788330315.625553:0:17121:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1788330315.626351:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792430976 00000100:00100000:3.0:1788330315.626366:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792430976 00000100:00100000:3.0:1788330315.626411:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788330315.626422:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875199792430976:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788330315.626446:0:17108:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:2.0:1788330315.630780:0:17121:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788330315.631062:0:17121:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788330315.632914:0:17121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788330315.633406:0:17121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788330315.642567:0:17121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788330315.643021:0:17127:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788330315.643028:0:17127:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788330315.644055:0:17121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788330315.644076:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788330315.644134:0:17121:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788330315.644326:0:17121:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd2047 00000100:00080000:2.0:1788330315.644343:0:17121:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788330315.644360:0:17121:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99eee7217000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330315.644541:0:17121:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc5ee9f80 x1875199792431104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788330315.644606:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792431104:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788330315.644705:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199792431104 offset 0 length 520: 4 00000100:00080000:2.0:1788330315.644775:0:17121:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788330315.644858:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330315.644863:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330315.644866:0:17121:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788330315.644868:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788330315.644872:0:17121:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788330315.644874:0:17121:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788330315.644875:0:17121:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788330315.644877:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788330315.644879:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330315.644881:0:17121:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788330315.644883:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788330315.644888:0:17121:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788330315.644891:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330315.644892:0:17121:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788330315.644895:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788330315.644899:0:17121:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:01000000:2.0:1788330315.644926:0:17121:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788330315.644929:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788330315.644954:0:17121:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99eec8bb0000) 00000020:00000080:2.0:1788330315.644970:0:17121:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788330315.644977:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788330315.645060:0:17121:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788330315.645069:0:17121:0:(osd_handler.c:8927:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788330315.645075:0:17121:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8475908e9fd2055 00010000:00080000:2.0:1788330315.645113:0:17121:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99eee721f000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.150@tcp at head 00010000:00010000:2.0:1788330315.645506:0:17121:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788330315.645600:0:17121:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788330315.645626:0:17121:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788330315.651315:0:17121:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788330315.651735:0:17121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788330315.651960:0:17121:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788330315.653630:0:17129:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788330315.653639:0:17129:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1788330315.656725:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875199792430976:12345-0@lo:38:llog_process_th.0 Request processed in 30291us (32072us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788330315.656747:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788330315.656841:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc759f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788330315.656847:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788330315.656852:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792430976:0@lo:38:llog_process_th.0 00000020:00000080:0.0:1788330315.657945:0:17121:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788330315.657966:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788330315.658037:0:17121:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788330315.658068:0:17121:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd205c 00000100:00080000:0.0:1788330315.658080:0:17121:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788330315.658087:0:17121:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99eee721f000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:0.0:1788330315.658140:0:17121:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eefd32f480 x1875199792431232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788330315.658211:0:17121:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788330315.658323:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788330315.658328:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330315.658330:0:17121:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788330315.658334:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788330315.658338:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330315.658340:0:17121:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788330315.658343:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788330315.658345:0:17121:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788330315.658355:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788330315.658359:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330315.658360:0:17121:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788330315.658363:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788330315.658366:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330315.658367:0:17121:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788330315.658371:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788330315.658424:0:17121:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17121:1875199792431360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788330315.658523:0:17121:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330315.658562:0:17121:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788330315.659844:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792431360 00000100:00100000:3.0:1788330315.659864:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792431360 00000100:00100000:3.0:1788330315.659981:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788330315.659995:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+9:17121:x1875199792431360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330315.660337:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+9:17121:x1875199792431360:12345-0@lo:502:llog_process_th.0 Request processed in 344us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330315.660346:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788330315.660968:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792431232:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788330315.661019:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199792431232 offset 0 length 520: 4 00000100:00100000:3.0:1788330315.661103:0:17121:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17121:1875199792431360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788330315.661367:0:17121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330315.661378:0:17121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330315.661381:0:17121:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788330315.661387:0:17121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788330315.661594:0:17082:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788330315.661621:0:17082:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788330315.661686:0:17082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1327200/0x8475908e9fd1fd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1fd7 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.661700:0:17082:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec1327200/0x8475908e9fd1fd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1fd7 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330315.661710:0:17082:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99edc7d05800 from 1 10000000:01000000:2.0:1788330315.661713:0:17082:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788330315.661761:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9039c00/0x8475908e9fd2063 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.661771:0:17082:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec9039c00/0x8475908e9fd2063 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.661783:0:17082:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec9039c00/0x8475908e9fd2063 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330315.661804:0:17082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792431488:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788330315.661853:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330315.661888:0:17082:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eed0837900 going to sleep for 11 seconds 00000100:00100000:0.0:1788330315.662132:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792431488 00000100:00100000:0.0:1788330315.662142:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792431488 00000100:00100000:0.0:1788330315.662353:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788330315.662364:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+9:17082:x1875199792431488:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330315.662382:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330315.662400:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec1327e00/0x8475908e9fd206a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2063 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330315.662427:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec1327e00/0x8475908e9fd206a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2063 expref: 10 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330315.662437:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec1327e00/0x8475908e9fd206a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2063 expref: 10 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330315.662447:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327e00, rc 0) 00000100:00100000:0.0:1788330315.662601:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+10:17082:x1875199792431488:12345-0@lo:101:mount.lustre.0 Request processed in 237us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330315.662609:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788330315.662782:0:17082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792431488:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330315.662802:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec9039c00/0x8475908e9fd2063 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd206a expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.662812:0:17082:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec9039c00/0x8475908e9fd2063 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd206a expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330315.663725:0:17082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792431616:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788330315.663807:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330315.663901:0:17082:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3717780 going to sleep for 11 seconds 00000100:00100000:0.0:1788330315.663949:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792431616 00000100:00100000:0.0:1788330315.663958:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792431616 00000100:00100000:0.0:1788330315.664068:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788330315.664079:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+10:17082:x1875199792431616:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788330315.664101:0:17098:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788330315.664109:0:17098:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788330315.664259:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+10:17082:x1875199792431616:12345-0@lo:256:mount.lustre.0 Request processed in 182us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330315.664268:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788330315.664359:0:17082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792431616:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788330315.664980:0:17082:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788330315.665018:0:17082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9039c00/0x8475908e9fd2063 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd206a expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.665031:0:17082:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec9039c00/0x8475908e9fd2063 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd206a expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330315.665041:0:17082:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99edc7d05800 from 1 10000000:01000000:3.0:1788330315.665045:0:17082:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788330315.665088:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd2071 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.665098:0:17082:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd2071 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.665111:0:17082:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd2071 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330315.665132:0:17082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792431744:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788330315.665221:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330315.665577:0:17082:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3717780 going to sleep for 11 seconds 00000100:00100000:2.0:1788330315.665664:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792431744 00000100:00100000:2.0:1788330315.665673:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792431744 00000100:00100000:2.0:1788330315.665714:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788330315.665726:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+10:17082:x1875199792431744:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788330315.665742:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330315.665761:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec9038400/0x8475908e9fd2078 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2071 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.665805:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9038400/0x8475908e9fd2078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2071 expref: 11 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.665817:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec9038400/0x8475908e9fd2078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2071 expref: 11 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.665827:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038400, rc 0) 00000100:00100000:2.0:1788330315.665881:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+11:17082:x1875199792431744:12345-0@lo:101:mount.lustre.0 Request processed in 157us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330315.665887:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788330315.665983:0:17082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792431744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330315.666012:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd2071 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2078 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.666023:0:17082:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd2071 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2078 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330315.666115:0:17082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792431872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330315.666147:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330315.666200:0:17082:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3717780 going to sleep for 11 seconds 00000100:00100000:2.0:1788330315.666261:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792431872 00000100:00100000:2.0:1788330315.666266:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792431872 00000100:00100000:2.0:1788330315.666286:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788330315.666292:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+11:17082:x1875199792431872:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330315.666490:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+11:17082:x1875199792431872:12345-0@lo:501:mount.lustre.0 Request processed in 196us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330315.666498:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788330315.666641:0:17082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792431872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330315.666675:0:17082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792432000:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788330315.666723:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330315.666756:0:17082:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec3717780 going to sleep for 11 seconds 00000100:00100000:0.0:1788330315.666824:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792432000 00000100:00100000:0.0:1788330315.666830:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792432000 00000100:00100000:0.0:1788330315.666859:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788330315.666866:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+11:17082:x1875199792432000:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330315.666972:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+11:17082:x1875199792432000:12345-0@lo:503:mount.lustre.0 Request processed in 106us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330315.666980:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788330315.667074:0:17082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792432000:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788330315.667671:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eeb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17131:1875199792432128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330315.667722:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330315.667756:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec31ec600 going to sleep for 11 seconds 00000100:00100000:0.0:1788330315.667801:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792432128 00000100:00100000:0.0:1788330315.667807:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792432128 00000100:00100000:0.0:1788330315.667842:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788330315.667850:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+11:17131:x1875199792432128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788330315.668423:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+11:17131:x1875199792432128:12345-0@lo:502:llog_process_th.0 Request processed in 571us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330315.668433:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788330315.668549:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eeb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17131:1875199792432128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788330315.668588:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330315.668601:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330315.668604:0:17131:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788330315.668614:0:17131:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99edc7d05800 00000020:00000080:3.0:1788330315.668616:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788330315.668628:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330315.668631:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330315.668632:0:17131:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788330315.668634:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330315.668637:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330315.668638:0:17131:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788330315.668641:0:17131:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99edc7d05800 00000020:00000080:3.0:1788330315.668650:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788330315.668729:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330315.668734:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330315.668736:0:17131:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788330315.668739:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330315.668743:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330315.668744:0:17131:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788330315.668748:0:17131:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99edc7d05800 00000020:00000080:3.0:1788330315.668751:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788330315.668768:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330315.668772:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330315.668773:0:17131:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788330315.668775:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330315.668777:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330315.668778:0:17131:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788330315.668781:0:17131:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99edc7d05800 00000020:00000080:3.0:1788330315.668783:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788330315.668827:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17131:1875199792432256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330315.668870:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330315.668895:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70b7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330315.670269:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792432256 00000100:00100000:3.0:1788330315.670286:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792432256 00000100:00100000:3.0:1788330315.670340:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788330315.670351:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+11:17131:x1875199792432256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330315.670556:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+11:17131:x1875199792432256:12345-0@lo:502:llog_process_th.0 Request processed in 206us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330315.670564:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788330315.670639:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17131:1875199792432256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788330315.670689:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330315.670703:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330315.670706:0:17131:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788330315.670711:0:17131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788330315.670805:0:17082:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788330315.670841:0:17082:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788330315.670870:0:17082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd2071 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2078 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.670886:0:17082:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd2071 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2078 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330315.670947:0:17082:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788330315.670951:0:17082:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99edc7d05800 10000000:01000000:3.0:1788330315.670954:0:17082:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99edc7d05800 10000000:01000000:3.0:1788330315.670958:0:17082:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788330315.670966:0:17082:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99edc7d05800 from 1 10000000:01000000:3.0:1788330315.670969:0:17082:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788330315.671006:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b200/0x8475908e9fd207f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.671017:0:17082:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147b200/0x8475908e9fd207f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.671028:0:17082:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147b200/0x8475908e9fd207f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330315.671051:0:17082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792432384:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788330315.671097:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330315.671134:0:17082:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330315.671179:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792432384 00000100:00100000:3.0:1788330315.671185:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792432384 00000100:00100000:3.0:1788330315.671227:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788330315.671235:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec908c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+11:17082:x1875199792432384:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330315.671248:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330315.671263:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec147be00/0x8475908e9fd2086 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd207f expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.671293:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec147be00/0x8475908e9fd2086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd207f expref: 12 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.671305:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec147be00/0x8475908e9fd2086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd207f expref: 12 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.671317:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147be00, rc 0) 00000100:00100000:3.0:1788330315.671350:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec908c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17082:x1875199792432384:12345-0@lo:101:mount.lustre.0 Request processed in 116us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330315.671356:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788330315.671393:0:17082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792432384:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330315.671407:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147b200/0x8475908e9fd207f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2086 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.671417:0:17082:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147b200/0x8475908e9fd207f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2086 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330315.671472:0:17082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792432512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330315.671499:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330315.671513:0:17082:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330315.671525:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792432512 00000100:00100000:3.0:1788330315.671529:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792432512 00000100:00100000:3.0:1788330315.671552:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788330315.671557:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec908d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17082:x1875199792432512:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330315.671671:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec908d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17082:x1875199792432512:12345-0@lo:501:mount.lustre.0 Request processed in 114us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330315.671677:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788330315.671699:0:17082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792432512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330315.671721:0:17082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792432640:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788330315.671751:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330315.671761:0:17082:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330315.671770:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792432640 00000100:00100000:3.0:1788330315.671772:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792432640 00000100:00100000:3.0:1788330315.671784:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788330315.671788:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17082:x1875199792432640:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788330315.671850:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17082:x1875199792432640:12345-0@lo:503:mount.lustre.0 Request processed in 61us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330315.671854:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788330315.671883:0:17082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792432640:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788330315.680531:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17132:1875199792432768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330315.680663:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330315.680719:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70b70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330315.680750:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792432768 00000100:00100000:3.0:1788330315.680760:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792432768 00000100:00100000:3.0:1788330315.680821:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788330315.680834:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17132:x1875199792432768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330315.681005:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17132:x1875199792432768:12345-0@lo:502:llog_process_th.0 Request processed in 173us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330315.681021:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788330315.681093:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17132:1875199792432768:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788330315.681210:0:17132:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788330315.681576:0:17132:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99eeffc4cd28) 00000020:00000080:3.0:1788330315.681604:0:17132:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788330315.681715:0:17132:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99edc7d05800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788330315.681721:0:17132:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99edc7d05800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788330315.681725:0:17132:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99edc7d05800 4 00010000:00080000:3.0:1788330315.681765:0:17132:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99eee7275800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.150@tcp at head 00010000:00010000:3.0:1788330315.688759:0:17132:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788330315.689070:0:17132:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788330315.689139:0:17132:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788330315.689212:0:17132:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8475908e9fd2094 00000100:00080000:3.0:1788330315.691400:0:17132:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788330315.691432:0:17132:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99eee7275800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330315.691494:0:17132:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc75ff800 x1875199792432896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788330315.691526:0:17132:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788330315.691829:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875199792432896:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788330315.691936:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330315.692274:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17132:1875199792433024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330315.692338:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330315.692375:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792433024 00000100:00100000:3.0:1788330315.692384:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792433024 00000100:00100000:3.0:1788330315.692436:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788330315.692448:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17132:x1875199792433024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330315.692610:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17132:x1875199792433024:12345-0@lo:502:llog_process_th.0 Request processed in 162us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330315.692629:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788330315.692688:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70b7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330315.692714:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17132:1875199792433024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330315.692760:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17132:1875199792433152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330315.692793:0:17132:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330315.692817:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792433152 00000100:00100000:3.0:1788330315.692822:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792433152 00000100:00100000:3.0:1788330315.692845:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788330315.692852:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17132:x1875199792433152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330315.692912:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17132:x1875199792433152:12345-0@lo:502:llog_process_th.0 Request processed in 60us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330315.692919:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788330315.692949:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc70b7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330315.692962:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17132:1875199792433152:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788330315.692980:0:17132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:0.0:1788330315.695673:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792432896 00000100:00100000:0.0:1788330315.695694:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792432896 00000100:00100000:0.0:1788330315.695748:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788330315.695758:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875199792432896:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788330315.695886:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875199792432896:12345-0@lo:38:llog_process_th.0 Request processed in 129us (3950us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788330315.695902:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788330315.695969:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788330315.695980:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eee7275800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788330315.695985:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788330315.695990:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875199792432896:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1788330315.696313:0:17082:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788330315.696358:0:17082:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788330315.696383:0:17082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b200/0x8475908e9fd207f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2086 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330315.696397:0:17082:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147b200/0x8475908e9fd207f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2086 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788330315.696459:0:17082:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788330315.696462:0:17082:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788330315.696464:0:17082:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788330315.696465:0:17082:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788330315.696467:0:17082:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788330315.696468:0:17082:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788330315.696470:0:17082:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788330315.696472:0:17082:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788330315.696475:0:17082:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788330315.696476:0:17082:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788330315.696481:0:17082:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788330315.696484:0:17082:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788330315.696485:0:17082:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788330315.696487:0:17082:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788330315.696488:0:17082:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788330315.696489:0:17082:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788330315.696490:0:17082:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788330315.696491:0:17082:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788330315.696492:0:17082:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788330315.696493:0:17082:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788330315.696500:0:17082:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788330315.696529:0:17082:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788330315.696552:0:17082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792433280:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788330315.696609:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330315.696651:0:17082:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788330315.696730:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792433280 00000100:00100000:3.0:1788330315.696737:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792433280 00000100:00100000:3.0:1788330315.696777:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788330315.696785:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17082:x1875199792433280:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788330315.696815:0:17098:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788330315.696833:0:17098:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788330315.708992:0:17098:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788330315.709028:0:17098:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788330315.709177:0:17119:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788330315.709182:0:17119:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788330315.709232:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99eec9039800/0x8475908e9fd209b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.709258:0:17119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eec1327e00/0x8475908e9fd206a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2063 expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.709268:0:17119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99eec9039800/0x8475908e9fd209b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.709319:0:17119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eec1327e00/0x8475908e9fd206a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd2063 expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.709336:0:17119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eec1327e00/0x8475908e9fd206a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd2063 expref: 12 pid: 17097 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330315.709355:0:17119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eea300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1875199792433408:0@lo:104: 00000100:00100000:2.0:1788330315.709447:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330315.709510:0:17119:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec31ec780 going to sleep for 11 seconds 00000100:00100000:2.0:1788330315.709841:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17082:x1875199792433280:12345-0@lo:253:mount.lustre.0 Request processed in 13054us (13230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330315.709854:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788330315.709938:0:17082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17082:1875199792433280:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788330315.709951:0:17082:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788330315.709955:0:17082:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788330315.709957:0:17082:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788330315.709959:0:17082:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788330315.709960:0:17082:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788330315.709961:0:17082:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788330315.709963:0:17082:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788330315.709965:0:17082:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788330315.709967:0:17082:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788330315.709969:0:17082:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788330315.709978:0:17082:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788330315.710000:0:17082:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788330315.711406:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792433408 00000100:00100000:1.0:1788330315.711634:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792433408 00000100:00100000:1.0:1788330315.711703:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788330315.711716:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+3:17119:x1875199792433408:12345-0@lo:104: 00010000:00010000:1.0:1788330315.711739:0:17086:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec9039c00/0x8475908e9fd2063 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd206a expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330315.711853:0:17086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788330315.711860:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+3:17119:x1875199792433408:12345-0@lo:104: Request processed in 147us (2414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330315.711868:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788330315.714779:0:17119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eea300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1875199792433408:0@lo:104: 00010000:00010000:2.0:1788330315.714814:0:17119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99eec9039800/0x8475908e9fd209b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.715520:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330315.715530:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec9039c00/0x8475908e9fd2063 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd206a expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.715540:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039c00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:2.0:1788330315.715546:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec9039c00/0x8475908e9fd2063 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd206a expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.715557:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec9039c00/0x8475908e9fd2063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd206a expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330315.715566:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec9039c00/0x8475908e9fd2063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd206a expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330315.715572:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788330315.715632:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec9039c00/0x8475908e9fd2063 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd206a expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.715639:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788330315.715666:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec9039c00/0x8475908e9fd2063 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd206a expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.715674:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec9039c00/0x8475908e9fd2063 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd206a expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330315.715704:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330315.715706:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330315.715707:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330315.715751:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330315.715770:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792433536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330315.715861:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330315.716524:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792433536 00000100:00100000:3.0:1788330315.716534:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792433536 00010000:00010000:3.0:1788330315.716569:0:17088:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eec1327e00/0x8475908e9fd206a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2063 expref: 12 pid: 17097 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330315.716636:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788330315.716647:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:3648:x1875199792433536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330315.716665:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330315.716672:0:17088:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eec1327e00/0x8475908e9fd206a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2063 expref: 12 pid: 17097 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.716684:0:17088:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eec1327e00/0x8475908e9fd206a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd2063 expref: 12 pid: 17097 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.716701:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec1327e00/0x8475908e9fd206a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd2063 expref: 12 pid: 17097 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.716719:0:17088:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99eec9039800/0x8475908e9fd209b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.716728:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9039800/0x8475908e9fd209b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788330315.716747:0:17088:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007564631s 00010000:00010000:3.0:1788330315.716752:0:17088:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eec9039800/0x8475908e9fd209b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.716760:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eec9039800/0x8475908e9fd209b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.716768:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99eec9039800/0x8475908e9fd209b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.716775:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99eec9039800/0x8475908e9fd209b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.716786:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330315.716791:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99eec9039800/0x8475908e9fd209b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.716800:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99eec9039800/0x8475908e9fd209b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.716817:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99eec9039800/0x8475908e9fd209b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.716829:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330315.716890:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+11:3648:x1875199792433536:12345-0@lo:103:ldlm_bl.0 Request processed in 244us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330315.716898:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788330315.716942:0:17119:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99eec9039800/0x8475908e9fd209b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.716950:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99eec9039800/0x8475908e9fd209b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330315.716956:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec9039800/0x8475908e9fd209b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330315.716995:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792433536:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788330315.725964:0:17082:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788330315.727693:0:17082:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788330315.727805:0:17143:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788330315.727812:0:17143:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1788330315.728309:0:17144:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788330315.728378:0:17082:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1788330315.728751:0:17145:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff99eefd32d180 x1875199792433664/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330315.728766:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 00000040:00080000:1.0:1788330315.729002:0:17144:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788330315.729489:0:17082:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788330315.729528:0:17082:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788330315.730250:0:17082:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788330315.730268:0:17082:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788330315.730318:0:17082:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788330315.731359:0:17082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788330315.732096:0:17082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788330315.732133:0:17082:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788330315.734146:0:17082:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000040:00080000:1.0:1788330315.735730:0:17144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788330315.735827:0:17144:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000001:00000004:3.0:1788330315.743819:0:17082:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788330315.753007:0:17082:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788330315.753385:0:17082:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb7bcc19bf988 00100000:10000000:3.0:1788330315.753396:0:17082:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788330315.757083:0:17082:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788330315.757110:0:17082:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.150@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788330315.757146:0:17082:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788330315.757187:0:17082:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788330315.764235:0:17082:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788330315.764498:0:17082:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788330316.323949:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330316.763407:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 00000040:00080000:2.0:1788330316.764460:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788330317.020356:0:17101:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788330317.020370:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99edc7d05800 from 7 10000000:01000000:1.0:1788330317.020378:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788330317.020450:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd20a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330317.020466:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd20a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330317.020481:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd20a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330317.020529:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e74e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792433792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788330317.020627:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330317.020703:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee74ff000 going to sleep for 11 seconds 00000100:00100000:3.0:1788330317.020781:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792433792 00000100:00100000:3.0:1788330317.020792:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792433792 00000100:00100000:3.0:1788330317.020859:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788330317.020871:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+11:17101:x1875199792433792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330317.020888:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330317.020906:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec147b000/0x8475908e9fd20a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd20a2 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330317.020934:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec147b000/0x8475908e9fd20a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd20a2 expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330317.020947:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec147b000/0x8475908e9fd20a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd20a2 expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330317.020958:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147b000, rc 0) 00000100:00100000:3.0:1788330317.021017:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17101:x1875199792433792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330317.021024:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788330317.021138:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e74e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792433792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330317.021189:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd20a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd20a9 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330317.021200:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd20a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd20a9 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330317.021271:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e74e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792433920:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788330317.021309:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330317.021334:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee74ff000 going to sleep for 11 seconds 00000100:00100000:3.0:1788330317.022358:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792433920 00000100:00100000:3.0:1788330317.022371:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792433920 00000100:00100000:3.0:1788330317.022426:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788330317.022438:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17101:x1875199792433920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788330317.022470:0:17098:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788330317.022494:0:17098:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788330317.022498:0:17098:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788330317.022635:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17101:x1875199792433920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 199us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330317.022645:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788330317.022792:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e74e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792433920:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788330317.022857:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788330317.022869:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd20a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd20a9 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330317.022880:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd20a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd20a9 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330317.345967:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330317.787324:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 00000040:00080000:0.0:1788330317.788113:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788330318.364576:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330318.812442:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 00010000:00010000:3.0:1788330319.389278:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330319.835315:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 00010000:00010000:2.0:1788330320.417411:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788330320.664139:0:17388:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1788330320.798381:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788330320.798390:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788330320.798395:0:36:0:(import.c:65:import_set_state_nolock()) ffff99edc759f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330320.798405:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 519 00000100:00080000:2.0:1788330320.798413:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788330320.798421:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99edc759f800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330320.798451:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc5eeb480 x1875199792434176/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788330320.798468:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330320.798473:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788330320.798488:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330320.798492:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788330320.798495:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788330320.798498:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788330320.798500:0:36:0:(import.c:65:import_set_state_nolock()) ffff99eee7275800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330320.798506:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99eee7275800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330320.798521:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc5ee8a80 x1875199792434304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788330320.798584:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788330320.798603:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3647:1875199792434048:0@lo:400:kworker.0 00000100:00100000:2.0:1788330320.798705:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330320.801546:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792434048 00000100:00100000:0.0:1788330320.801572:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792434048 00000100:00100000:0.0:1788330320.801648:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788330320.801660:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:3647:x1875199792434048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330320.801804:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:3647:x1875199792434048:12345-0@lo:400:kworker.0 Request processed in 146us (3098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330320.801812:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788330320.801872:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792434176:0@lo:38:kworker.0 00000100:00100000:0.0:1788330320.801920:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330320.801952:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875199792434304:0@lo:38:kworker.0 00000100:00100000:0.0:1788330320.801979:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330320.802031:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792434176 00000100:00100000:0.0:1788330320.802035:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792434176 00000100:00100000:0.0:1788330320.802057:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788330320.802077:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875199792434176:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788330320.802100:0:17109:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788330320.806382:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792434304 00000100:00100000:2.0:1788330320.806405:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792434304 00000100:00100000:2.0:1788330320.806476:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788330320.806488:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875199792434304:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788330320.806528:0:17105:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:2.0:1788330320.806575:0:17105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8475908e9fd20b0 00000004:00100000:2.0:1788330320.806600:0:17105:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788330320.806780:0:17105:0:(import.c:65:import_set_state_nolock()) ffff99eee721a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330320.806912:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875199792434304:12345-0@lo:38:kworker.0 Request processed in 423us (4929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330320.806920:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788330320.806987:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99edc5ee8a80 x1875199792434304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788330330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788330320.807010:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788330320.807035:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788330320.807041:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788330320.807044:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eee7275800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788330320.807052:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875199792434304:0@lo:38:kworker.0 00000100:00100000:2.0:1788330320.818681:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3647:1875199792434048:0@lo:400:kworker.0 00000100:00100000:0.0:1788330320.846245:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875199792434176:12345-0@lo:38:kworker.0 Request processed in 44156us (44314us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788330320.846265:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788330320.855638:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc759f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330320.855660:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788330320.855667:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792434176:0@lo:38:kworker.0 00000100:00100000:0.0:1788330320.869301:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 00010000:00010000:3.0:1788330321.472830:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330321.893958:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 00000020:00000004:3.0:1788330322.000519:0:17440:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788330322.000805:0:17440:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788330322.523512:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330322.908030:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 00000020:00000004:0.0:1788330323.092983:0:17490:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788330323.093284:0:17490:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788330323.547472:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330323.931605:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 00010000:00010000:2.0:1788330324.571373:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330324.962377:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 00010000:00010000:2.0:1788330325.601825:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330325.915238:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330315/real 1788330315] req@ffff99eefd32f480 x1875199792431232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330325 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330325.915280:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99eefd32f480 x1875199792431232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330325 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330325.915290:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330315/real 1788330315] req@ffff99edc5ee9f80 x1875199792431104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330325 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330325.915301:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99edc5ee9f80 x1875199792431104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330325 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788330325.915322:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eee721f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788330325.915346:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788330325.915350:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792431232:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788330325.915356:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eee7217000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788330325.915362:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788330325.915365:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792431104:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788330325.915828:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3647:1875199792434432:0@lo:400:kworker.0 00000100:00100000:0.0:1788330325.915907:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788330325.915985:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788330325.915990:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788330325.915993:0:36:0:(import.c:65:import_set_state_nolock()) ffff99edc759f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330325.915999:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:2.0:1788330325.916003:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788330325.916009:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99edc759f800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330325.916032:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc5ee8a80 x1875199792434560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788330325.916046:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330325.916049:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788330325.916050:0:36:0:(import.c:65:import_set_state_nolock()) ffff99eee7217000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330325.916053:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 519 00000100:00080000:2.0:1788330325.916056:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788330325.916058:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99eee7217000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330325.916070:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc5ee8e00 x1875199792434688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788330325.916077:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330325.916089:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788330325.916090:0:36:0:(import.c:65:import_set_state_nolock()) ffff99eee721f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330325.916107:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 519 00000100:00080000:2.0:1788330325.916110:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788330325.916114:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99eee721f000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330325.916128:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc5ee8000 x1875199792434816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788330325.916188:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792434944:0@lo:400:kworker.0 00000100:00100000:2.0:1788330325.916220:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330325.920412:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792434432 00000100:00100000:1.0:1788330325.920448:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792434432 00000100:00100000:1.0:1788330325.920506:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788330325.920518:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:3647:x1875199792434432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330325.924947:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:3647:x1875199792434432:12345-0@lo:400:kworker.0 Request processed in 4421us (9029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330325.924962:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788330325.925038:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792434560:0@lo:38:kworker.0 00000100:00100000:1.0:1788330325.925104:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330325.925148:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792434688:0@lo:8:kworker.0 00000400:00000100:1.0:1788330325.925191:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199792434688 offset 0 length 520: 4 00000100:00100000:1.0:1788330325.925226:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792434816:0@lo:8:kworker.0 00000400:00000100:1.0:1788330325.925246:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199792434816 offset 0 length 520: 4 00000100:00100000:1.0:1788330325.925281:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792434560 00000100:00100000:1.0:1788330325.925289:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792434560 00000100:00100000:1.0:1788330325.925319:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788330325.925325:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875199792434560:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788330325.925344:0:17108:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788330325.935533:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792434944 00000100:00100000:0.0:1788330325.935553:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792434944 00000100:00100000:0.0:1788330325.935614:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788330325.935626:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792434944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330325.935768:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792434944:12345-0@lo:400:kworker.0 Request processed in 144us (19546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330325.935777:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788330325.935977:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99edc5eebb80 x1875199792434944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330325.935993:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792434944:0@lo:400:kworker.0 00000100:00100000:0.0:1788330325.936216:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3647:1875199792434432:0@lo:400:kworker.0 00000100:00100000:0.0:1788330325.945306:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875199792434560:12345-0@lo:38:kworker.0 Request processed in 19969us (20200us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788330325.945321:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788330325.945348:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc759f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330325.945354:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788330325.945358:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792434560:0@lo:38:kworker.0 00000100:00100000:1.0:1788330325.983447:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 00010000:00010000:2.0:1788330326.624673:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330327.003265:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 00000040:00080000:1.0:1788330327.068060:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788330327.643901:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330328.028254:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 00010000:00010000:1.0:1788330328.668408:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330329.051348:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 00010000:00010000:0.0:1788330329.692310:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330330.100634:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 00010000:00010000:1.0:1788330330.716535:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788330331.043764:0:13408:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788330331.044341:0:13408:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788330331.044348:0:13408:0:(import.c:65:import_set_state_nolock()) ffff99edc759f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330331.044359:0:13408:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 529 00000100:00080000:1.0:1788330331.044367:0:13408:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788330331.044378:0:13408:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99edc759f800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330331.044417:0:13408:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7e74000 x1875199792435200/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788330331.044503:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792435200:0@lo:38:kworker.0 00000100:00100000:3.0:1788330331.044619:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788330331.044712:0:13408:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330331.044717:0:13408:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788330331.044720:0:13408:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330331.044724:0:13408:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788330331.044765:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792435328:0@lo:400:kworker.0 00000100:00100000:1.0:1788330331.044826:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330331.044889:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792435328 00000100:00100000:1.0:1788330331.044902:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792435328 00000100:00100000:1.0:1788330331.044965:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788330331.044977:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792435328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330331.045038:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792435328:12345-0@lo:400:kworker.0 Request processed in 63us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330331.045059:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788330331.045109:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99edc7e75880 x1875199792435328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330331.045171:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792435328:0@lo:400:kworker.0 00000100:00100000:0.0:1788330331.046203:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330331.046229:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792435072:0@lo:400:kworker.0 00000100:00100000:0.0:1788330331.046320:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330331.046383:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792435200 00000100:00100000:0.0:1788330331.046390:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792435200 00000100:00100000:0.0:1788330331.046424:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788330331.046432:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875199792435200:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788330331.046457:0:17109:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788330331.047578:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792435072 00000100:00100000:2.0:1788330331.047595:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792435072 00000100:00100000:2.0:1788330331.047658:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788330331.047668:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec909c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:3648:x1875199792435072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330331.047767:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec909c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:3648:x1875199792435072:12345-0@lo:400:kworker.0 Request processed in 101us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330331.047786:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788330331.063461:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792435072:0@lo:400:kworker.0 00000100:00100000:1.0:1788330331.076138:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875199792435200:12345-0@lo:38:kworker.0 Request processed in 29695us (31509us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788330331.076221:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788330331.076733:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc759f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788330331.076898:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788330331.076905:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792435200:0@lo:38:kworker.0 00000100:00100000:3.0:1788330331.164655:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 00000020:01000004:2.0:1788330331.367013:0:17836:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788330331.367021:0:17836:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788330331.367024:0:17836:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788330331.367563:0:17836:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99eee721d800 00000020:01000004:2.0:1788330331.367591:0:17836:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788330331.367609:0:17836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788330331.367629:0:17836:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff99eec8bb3370) 00000020:00000080:2.0:1788330331.367650:0:17836:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788330331.447961:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788330331.451003:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788330331.464903:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788330331.466689:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788330331.475507:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788330331.479777:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788330331.485632:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788330331.491425:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788330331.492665:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788330331.493477:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788330331.493931:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788330331.494609:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788330331.495881:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788330331.496903:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788330331.497983:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788330331.498712:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788330331.499432:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788330331.500825:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788330331.502415:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788330331.503400:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788330331.503719:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788330331.504712:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788330331.505621:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788330331.506024:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788330331.506466:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788330331.506761:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788330331.507396:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788330331.507723:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788330331.512020:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788330331.513647:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788330331.516066:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788330331.517416:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788330331.518388:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788330331.519615:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788330331.523367:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788330331.523715:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1788330331.523986:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788330331.525895:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788330331.526427:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788330331.526837:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788330331.527185:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788330331.527653:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788330331.527911:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1788330331.528697:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1788330331.529357:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788330331.529675:0:17836:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:1.0:1788330331.531705:0:17836:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788330331.532249:0:17836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1788330331.532267:0:17836:0:(osd_handler.c:8927:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788330331.532285:0:17836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8475908e9fd20be 00000020:01000004:1.0:1788330331.532297:0:17836:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788330331.532325:0:17836:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.150@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788330331.532330:0:17836:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788330331.532339:0:17836:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1788330331.532379:0:17836:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1788330331.532386:0:17836:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.150@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788330331.557483:0:17836:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788330331.557553:0:17836:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.150@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1788330331.557565:0:17836:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788330331.557567:0:17836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788330331.557568:0:17836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330331.557570:0:17836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330331.557571:0:17836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330331.557573:0:17836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330331.557574:0:17836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788330331.557576:0:17836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330331.557578:0:17836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788330331.557582:0:17836:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1788330331.557585:0:17836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788330331.557586:0:17836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788330331.557587:0:17836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330331.557588:0:17836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330331.557589:0:17836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330331.557590:0:17836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330331.557591:0:17836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788330331.557592:0:17836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330331.557593:0:17836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788330331.557633:0:17836:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788330331.557662:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792435456:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788330331.557780:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330331.557858:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10883c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330331.558088:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792435456 00000100:00100000:0.0:1788330331.558099:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792435456 00000100:00100000:0.0:1788330331.558208:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788330331.558231:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec909fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17836:x1875199792435456:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788330331.558274:0:17095:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788330331.558278:0:17095:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788330331.558290:0:17095:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788330331.559926:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec909fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17836:x1875199792435456:12345-0@lo:253:mount.lustre.0 Request processed in 1696us (2134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330331.559942:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788330331.560230:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792435456:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788330331.560251:0:17836:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788330331.560255:0:17836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788330331.560257:0:17836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788330331.560258:0:17836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330331.560259:0:17836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330331.560260:0:17836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330331.560262:0:17836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330331.560263:0:17836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788330331.560266:0:17836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330331.560267:0:17836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788330331.560324:0:17836:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99eee721d800 from lustre-MDT0001 10000000:01000000:1.0:1788330331.560367:0:17836:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788330331.560370:0:17836:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788330331.560394:0:17836:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99edc67d8000 local copy 00010000:00010000:1.0:1788330331.560409:0:17836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd1fb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1fbb expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330331.560575:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792435584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330331.560631:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330331.563749:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc1088480 going to sleep for 11 seconds 00000100:00100000:2.0:1788330331.567146:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792435584 00000100:00100000:2.0:1788330331.567200:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792435584 00000100:00100000:2.0:1788330331.567682:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788330331.567697:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec909c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17836:x1875199792435584:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330331.568324:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec909c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17836:x1875199792435584:12345-0@lo:501:mount.lustre.0 Request processed in 629us (7690us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788330331.568354:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788330331.568425:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792435584:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788330331.568455:0:17836:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788330331.568487:0:17836:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788330331.568498:0:17836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd1fb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1fbb expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330331.568512:0:17836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd1fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1fbb expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330331.568578:0:17836:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99eee721d800 10000000:01000000:1.0:1788330331.568585:0:17836:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788330331.568592:0:17836:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99edc67d8000 10000000:01000000:1.0:1788330331.568595:0:17836:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788330331.568598:0:17836:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99edc67d8000 from 1 10000000:01000000:1.0:1788330331.568602:0:17836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788330331.568642:0:17836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd20c5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330331.568651:0:17836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd20c5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330331.568663:0:17836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd20c5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330331.568696:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792435712:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788330331.568741:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330331.577957:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc1088480 going to sleep for 11 seconds 00000100:00100000:0.0:1788330331.579427:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792435712 00000100:00100000:0.0:1788330331.579455:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792435712 00000100:00100000:0.0:1788330331.579536:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788330331.579548:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+12:17836:x1875199792435712:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330331.579572:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330331.579600:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec1326600/0x8475908e9fd20cc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd20c5 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.579637:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec1326600/0x8475908e9fd20cc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd20c5 expref: 13 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.579649:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec1326600/0x8475908e9fd20cc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd20c5 expref: 13 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.579660:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326600, rc 0) 00000100:00100000:0.0:1788330331.579891:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+13:17836:x1875199792435712:12345-0@lo:101:mount.lustre.0 Request processed in 344us (11148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330331.579899:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788330331.579937:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792435712:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330331.579958:0:17836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd20c5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd20cc expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330331.579969:0:17836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd20c5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd20cc expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330331.579994:0:17836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788330331.580016:0:17836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd20c5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd20cc expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330331.580024:0:17836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eefe7efa00/0x8475908e9fd20c5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd20cc expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330331.580053:0:17836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99eee721d800 10000000:01000000:1.0:1788330331.580059:0:17836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788330331.580064:0:17836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99eee721d800 from 1 10000000:01000000:1.0:1788330331.580067:0:17836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788330331.580098:0:17836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7efe00/0x8475908e9fd20d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330331.580106:0:17836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eefe7efe00/0x8475908e9fd20d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330331.580114:0:17836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eefe7efe00/0x8475908e9fd20d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330331.580147:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792435840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788330331.580865:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330331.580906:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc1088480 going to sleep for 11 seconds 00000100:00100000:0.0:1788330331.580962:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792435840 00000100:00100000:0.0:1788330331.580969:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792435840 00000100:00100000:0.0:1788330331.581009:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788330331.581017:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec909ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+13:17836:x1875199792435840:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330331.581029:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330331.581052:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec1327a00/0x8475908e9fd20da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd20d3 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.581071:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec1327a00/0x8475908e9fd20da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd20d3 expref: 14 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.581143:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec1327a00/0x8475908e9fd20da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd20d3 expref: 14 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.581422:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327a00, rc 0) 00000100:00100000:0.0:1788330331.581606:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec909ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+14:17836:x1875199792435840:12345-0@lo:101:mount.lustre.0 Request processed in 589us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330331.581613:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788330331.586924:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792435840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788330331.586964:0:17836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eefe7efe00/0x8475908e9fd20d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd20da expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330331.586976:0:17836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eefe7efe00/0x8475908e9fd20d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd20da expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330331.586996:0:17836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788330331.587004:0:17836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7efe00/0x8475908e9fd20d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd20da expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330331.587011:0:17836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eefe7efe00/0x8475908e9fd20d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd20da expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330331.587018:0:17836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788330331.587027:0:17836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788330331.587032:0:17836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99eee721d800 10000000:01000000:2.0:1788330331.587034:0:17836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788330331.587039:0:17836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788330331.587050:0:17836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788330331.588008:0:17836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd20e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330331.588023:0:17836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd20e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330331.588033:0:17836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd20e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330331.588074:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792435968:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788330331.588418:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330331.588527:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec1254780 going to sleep for 11 seconds 00000100:00100000:0.0:1788330331.591606:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792435968 00000100:00100000:0.0:1788330331.591628:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792435968 00000100:00100000:0.0:1788330331.591790:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788330331.591804:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+14:17836:x1875199792435968:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330331.591828:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330331.591852:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec1327c00/0x8475908e9fd20e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd20e1 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.591914:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec1327c00/0x8475908e9fd20e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd20e1 expref: 15 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.591927:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec1327c00/0x8475908e9fd20e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd20e1 expref: 15 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.591939:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327c00, rc 0) 00000100:00100000:0.0:1788330331.592064:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+15:17836:x1875199792435968:12345-0@lo:101:mount.lustre.0 Request processed in 264us (3648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330331.592072:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788330331.592147:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792435968:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330331.592189:0:17836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd20e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd20e8 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330331.592218:0:17836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd20e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd20e8 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788330331.596880:0:17836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1788330331.598061:0:17836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788330331.605861:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788330331.605944:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788330331.605962:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788330331.605979:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788330331.605992:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1788330331.606006:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1788330331.606019:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1788330331.606037:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788330331.606065:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788330331.606081:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1788330331.606095:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1788330331.606108:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1788330331.606121:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1788330331.606132:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788330331.606143:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788330331.606428:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1788330331.606445:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788330331.606459:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788330331.606473:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1788330331.606500:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788330331.606516:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788330331.606530:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1788330331.606544:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1788330331.606580:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1788330331.606587:0:17836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1788330331.606862:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792436096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330331.606961:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330331.607485:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc1088c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788330331.607619:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792436096 00000100:00100000:0.0:1788330331.607629:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792436096 00000100:00100000:0.0:1788330331.607699:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788330331.607712:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+15:17836:x1875199792436096:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330331.608111:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+15:17836:x1875199792436096:12345-0@lo:501:mount.lustre.0 Request processed in 399us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330331.608120:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788330331.608610:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792436096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330331.608671:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792436224:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788330331.608737:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330331.608821:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc1088c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788330331.608916:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792436224 00000100:00100000:0.0:1788330331.608923:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792436224 00000100:00100000:0.0:1788330331.608969:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788330331.608978:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+15:17836:x1875199792436224:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330331.610589:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+15:17836:x1875199792436224:12345-0@lo:503:mount.lustre.0 Request processed in 1600us (1840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330331.610607:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788330331.610945:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792436224:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788330331.611998:0:17836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788330331.612578:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792436352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330331.613964:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330331.614049:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc1088840 going to sleep for 11 seconds 00000100:00100000:0.0:1788330331.614097:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792436352 00000100:00100000:0.0:1788330331.614109:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792436352 00000100:00100000:0.0:1788330331.614967:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788330331.614982:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+15:17836:x1875199792436352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330331.617478:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792436352:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330331.618050:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+15:17836:x1875199792436352:12345-0@lo:502:mount.lustre.0 Request processed in 2236us (3258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330331.618067:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000040:00080000:3.0:1788330331.620622:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788330331.620912:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1788330331.620934:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1788330331.620947:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1788330331.620959:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1788330331.620972:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1788330331.620984:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1788330331.621011:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1788330331.621022:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1788330331.621033:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1788330331.621058:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1788330331.621075:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1788330331.621090:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1788330331.621103:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1788330331.621115:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1788330331.621130:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1788330331.621143:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1788330331.621188:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1788330331.621220:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1788330331.622447:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1788330331.622464:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1788330331.622477:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1788330331.622489:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1788330331.622501:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1788330331.622513:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1788330331.622525:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1788330331.622537:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1788330331.622551:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1788330331.622562:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1788330331.622575:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1788330331.622588:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1788330331.622601:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1788330331.622617:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1788330331.622631:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1788330331.622644:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1788330331.622659:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1788330331.622674:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1788330331.622688:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1788330331.622702:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1788330331.622731:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1788330331.622768:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1788330331.623619:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1788330331.623639:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1788330331.623654:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1788330331.623979:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792436480:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330331.624108:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330331.624218:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec1254780 going to sleep for 11 seconds 00000100:00100000:0.0:1788330331.624663:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792436480 00000100:00100000:0.0:1788330331.624676:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792436480 00000100:00100000:0.0:1788330331.624761:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788330331.624782:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+15:17836:x1875199792436480:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330331.624981:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+15:17836:x1875199792436480:12345-0@lo:502:mount.lustre.0 Request processed in 209us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330331.624990:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788330331.625253:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792436480:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788330331.625356:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1788330331.625373:0:17836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788330331.632572:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330331.632601:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330331.632605:0:17840:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788330331.632615:0:17840:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788330331.632620:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788330331.632649:0:17840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff99eeffc48000) 00000020:00000080:3.0:1788330331.632691:0:17840:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788330331.632700:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788330331.632823:0:17840:0:(osd_handler.c:8927:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788330331.632835:0:17840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8475908e9fd20f6 00000020:00000080:3.0:1788330331.633244:0:17840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788330331.633250:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330331.633255:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330331.633257:0:17840:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788330331.633260:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330331.633264:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330331.633265:0:17840:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788330331.633269:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788330331.633278:0:17840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff99eeffc499b8) 00000020:00000080:3.0:1788330331.633291:0:17840:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788330331.633296:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788330331.633305:0:17840:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788330331.633308:0:17840:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788330331.633316:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788330331.633380:0:17840:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99eee721d800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788330331.633397:0:17840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff99eeffc4b370) 00000020:00000080:3.0:1788330331.633409:0:17840:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788330331.633482:0:17840:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788330331.633492:0:17840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd210b 00000020:00000080:3.0:1788330331.633602:0:17840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788330331.633612:0:17840:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788330331.633619:0:17840:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x8475908e9fd2112 00080000:01000000:3.0:1788330331.633625:0:17840:0:(osd_handler.c:8927:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788330331.633628:0:17840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8475908e9fd2119 00010000:00010000:0.0:1788330331.739817:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330331.794259:0:17840:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788330331.797992:0:17840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1788330331.799424:0:17840:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788330331.803304:0:17840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788330331.803321:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330331.803329:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330331.803332:0:17840:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788330331.803336:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330331.803343:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330331.803344:0:17840:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788330331.803347:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788330331.803354:0:17840:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:00000080:3.0:1788330331.803388:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788330331.803406:0:17840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff99eee7570000) 00000020:00000080:3.0:1788330331.803434:0:17840:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788330331.803439:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788330331.803523:0:17840:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788330331.803531:0:17840:0:(osd_handler.c:8927:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788330331.803537:0:17840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8475908e9fd2127 00010000:00080000:3.0:1788330331.803574:0:17840:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99eef58df000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.150@tcp at head 00010000:00010000:2.0:1788330331.808247:0:17840:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788330331.810585:0:17840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788330331.810609:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788330331.810679:0:17840:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788330331.810716:0:17840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd212e 00000100:00080000:3.0:1788330331.810735:0:17840:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788330331.810745:0:17840:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99eef58df000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330331.810804:0:17840:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc75fea00 x1875199792436608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788330331.810834:0:17840:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788330331.810899:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330331.810903:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330331.810905:0:17840:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788330331.810908:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788330331.810912:0:17840:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788330331.810914:0:17840:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788330331.810915:0:17840:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788330331.810917:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788330331.810920:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330331.810921:0:17840:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788330331.810924:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330331.810929:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330331.810931:0:17840:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788330331.810935:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788330331.810974:0:17840:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788330331.810988:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330331.810991:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330331.810993:0:17840:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788330331.810995:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788330331.810997:0:17840:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1788330331.810998:0:17840:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788330331.811000:0:17840:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788330331.811001:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788330331.811004:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330331.811005:0:17840:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788330331.811008:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788330331.811018:0:17840:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788330331.811023:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330331.811024:0:17840:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788330331.811028:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788330331.811032:0:17840:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:01000000:3.0:1788330331.811076:0:17840:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788330331.811079:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788330331.811098:0:17840:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff99eee7573370) 00000020:00000080:3.0:1788330331.811113:0:17840:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788330331.811118:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788330331.812549:0:17840:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788330331.812560:0:17840:0:(osd_handler.c:8927:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788330331.812574:0:17840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8475908e9fd213c 00010000:00080000:3.0:1788330331.812623:0:17840:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99eec289b000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.150@tcp at head 00010000:00010000:3.0:1788330331.812806:0:17840:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:3.0:1788330331.815355:0:17840:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788330331.815756:0:17840:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1788330331.816296:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792436608:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788330331.816403:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330331.816783:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792436608 00000100:00100000:0.0:1788330331.816796:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792436608 00000100:00100000:0.0:1788330331.816856:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788330331.816867:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875199792436608:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788330331.816906:0:17108:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:0.0:1788330331.816965:0:17108:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd2143 00000004:00100000:0.0:1788330331.816988:0:17108:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788330331.816996:0:17108:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1788330331.818129:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330331.818138:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788330331.818141:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330331.818145:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788330331.820743:0:17840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788330331.820920:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788330331.821400:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1788330331.822109:0:17845:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788330331.822119:0:17845:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00080000:1.0:1788330331.824727:0:17108:0:(import.c:65:import_set_state_nolock()) ffff99eee7270800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788330331.824909:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875199792436608:12345-0@lo:38:llog_process_th.0 Request processed in 8037us (8502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330331.824924:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788330331.825199:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788330331.825394:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788330331.825407:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788330331.825414:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788330331.825418:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eef58df000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788330331.825439:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792436608:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788330331.825599:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330331.825622:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792436736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330331.825712:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330331.825981:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792436736 00000100:00100000:1.0:1788330331.825990:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792436736 00000100:00100000:1.0:1788330331.826059:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788330331.826071:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875199792436736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788330331.826122:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788330331.826197:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875199792436736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330331.826228:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788330331.826277:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792436736:0@lo:41:osp-pre-0-1.0 00000020:00000080:2.0:1788330331.827926:0:17840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788330331.827948:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788330331.828005:0:17840:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788330331.828029:0:17840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd214a 00000100:00080000:2.0:1788330331.828051:0:17840:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788330331.829548:0:17840:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99eec289b000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330331.829611:0:17840:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc5ee9880 x1875199792436864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788330331.829641:0:17840:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788330331.829807:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330331.829814:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330331.829816:0:17840:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788330331.829819:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788330331.829823:0:17840:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788330331.829825:0:17840:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788330331.829838:0:17840:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788330331.829840:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788330331.829842:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330331.829844:0:17840:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788330331.829846:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788330331.829851:0:17840:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788330331.829854:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330331.829856:0:17840:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788330331.829858:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788330331.829862:0:17840:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.150@tcp to nid 0x20000c0a8ca96 (192.168.202.150@tcp) 00000020:01000000:2.0:1788330331.829892:0:17840:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788330331.829895:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788330331.829915:0:17840:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff99eec8bb19b8) 00000020:00000080:2.0:1788330331.830006:0:17840:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788330331.830013:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788330331.830125:0:17840:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788330331.830132:0:17840:0:(osd_handler.c:8927:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788330331.830141:0:17840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x8475908e9fd2158 00000100:00100000:3.0:1788330331.830230:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792436864:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788330331.830313:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199792436864 offset 0 length 520: 4 00010000:00080000:2.0:1788330331.830436:0:17840:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc7e25800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.150@tcp at head 00000100:00080000:0.0:1788330331.830513:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330331.830520:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788330331.830533:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330331.830536:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788330331.830754:0:17840:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788330331.830865:0:17840:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788330331.830890:0:17840:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788330331.835141:0:17840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788330331.839950:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788330331.840368:0:17840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788330331.840917:0:17847:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788330331.840924:0:17847:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788330331.842619:0:17840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788330331.842636:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788330331.842754:0:17840:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788330331.842787:0:17840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd215f 00000100:00080000:2.0:1788330331.842803:0:17840:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788330331.842821:0:17840:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99edc7e25800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330331.842870:0:17840:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc5eeb100 x1875199792436992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788330331.842951:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792436992:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788330331.843032:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199792436992 offset 0 length 520: 4 00000100:00080000:2.0:1788330331.843310:0:17840:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788330331.843390:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330331.843395:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330331.843398:0:17840:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788330331.843400:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330331.843406:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330331.843407:0:17840:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788330331.843410:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788330331.843412:0:17840:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788330331.843414:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330331.843416:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330331.843418:0:17840:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788330331.843419:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330331.843422:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330331.843423:0:17840:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788330331.843426:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788330331.843465:0:17840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330331.843469:0:17840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330331.843470:0:17840:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788330331.843473:0:17840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1788330331.843696:0:17836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788330331.843737:0:17836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788330331.843761:0:17836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd20e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd20e8 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.843774:0:17836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147b600/0x8475908e9fd20e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd20e8 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330331.843783:0:17836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99eee721d800 from 1 10000000:01000000:0.0:1788330331.843786:0:17836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788330331.843822:0:17836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1327e00/0x8475908e9fd2166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.843830:0:17836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec1327e00/0x8475908e9fd2166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.843845:0:17836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec1327e00/0x8475908e9fd2166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330331.843867:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792437120:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788330331.843918:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330331.843980:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eed0050780 going to sleep for 11 seconds 00000100:00080000:0.0:1788330331.844002:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330331.844007:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788330331.844010:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330331.844022:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788330331.845406:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792437120 00000100:00100000:2.0:1788330331.845426:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792437120 00000100:00100000:2.0:1788330331.845504:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788330331.845516:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+15:17836:x1875199792437120:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788330331.845541:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330331.845565:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec9038000/0x8475908e9fd216d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2166 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330331.845619:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9038000/0x8475908e9fd216d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2166 expref: 16 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330331.845632:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec9038000/0x8475908e9fd216d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2166 expref: 16 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330331.845648:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038000, rc 0) 00000100:00100000:2.0:1788330331.845772:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+16:17836:x1875199792437120:12345-0@lo:101:mount.lustre.0 Request processed in 258us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330331.845779:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788330331.845968:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792437120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330331.845997:0:17836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec1327e00/0x8475908e9fd2166 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd216d expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330331.846010:0:17836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec1327e00/0x8475908e9fd2166 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd216d expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330331.848452:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792437248:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788330331.848577:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330331.848645:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788330331.848831:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792437248 00000100:00100000:2.0:1788330331.848845:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792437248 00000100:00100000:2.0:1788330331.848919:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788330331.848933:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+16:17836:x1875199792437248:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788330331.848967:0:17097:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788330331.848993:0:17097:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788330331.848997:0:17097:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788330331.849464:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+16:17836:x1875199792437248:12345-0@lo:256:mount.lustre.0 Request processed in 532us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330331.849474:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788330331.849808:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792437248:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788330331.850941:0:17836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788330331.851051:0:17836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1327e00/0x8475908e9fd2166 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd216d expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330331.851066:0:17836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec1327e00/0x8475908e9fd2166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd216d expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330331.851086:0:17836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eee721d800 from 1 10000000:01000000:3.0:1788330331.851089:0:17836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788330331.851142:0:17836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd2174 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330331.851186:0:17836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd2174 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330331.851197:0:17836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd2174 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330331.851249:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792437376:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788330331.851325:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330331.851365:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788330331.851591:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792437376 00000100:00100000:0.0:1788330331.851601:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792437376 00000100:00100000:0.0:1788330331.851663:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788330331.851684:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+16:17836:x1875199792437376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330331.851701:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330331.851716:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec1326c00/0x8475908e9fd217b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2174 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.851746:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec1326c00/0x8475908e9fd217b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2174 expref: 17 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.851758:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec1326c00/0x8475908e9fd217b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2174 expref: 17 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.851769:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326c00, rc 0) 00000100:00100000:0.0:1788330331.851824:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:17836:x1875199792437376:12345-0@lo:101:mount.lustre.0 Request processed in 142us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330331.851831:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788330331.851960:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792437376:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330331.851977:0:17836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd2174 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd217b expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330331.851987:0:17836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd2174 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd217b expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788330331.852382:0:17836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788330331.852427:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792437504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330331.852464:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330331.852497:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330331.852550:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792437504 00000100:00100000:2.0:1788330331.852556:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792437504 00000100:00100000:2.0:1788330331.852599:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788330331.852608:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:17836:x1875199792437504:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330331.852718:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:17836:x1875199792437504:12345-0@lo:501:mount.lustre.0 Request processed in 111us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330331.852726:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788330331.852936:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792437504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330331.852967:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792437632:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788330331.853007:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330331.853030:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330331.853095:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792437632 00000100:00100000:2.0:1788330331.853100:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792437632 00000100:00100000:2.0:1788330331.853137:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788330331.853144:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:17836:x1875199792437632:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788330331.853450:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:17836:x1875199792437632:12345-0@lo:503:mount.lustre.0 Request processed in 305us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330331.853457:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788330331.853530:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792437632:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788330331.854025:0:17836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788330331.854374:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792437760:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330331.854427:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330331.854523:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee765d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788330331.854766:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792437760 00000100:00100000:0.0:1788330331.854774:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792437760 00000100:00100000:0.0:1788330331.854858:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788330331.854869:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:17836:x1875199792437760:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330331.855012:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:17836:x1875199792437760:12345-0@lo:502:mount.lustre.0 Request processed in 144us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330331.855020:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788330331.855131:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792437760:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788330331.855452:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788330331.855491:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1788330331.855504:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1788330331.855517:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1788330331.855529:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1788330331.855540:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1788330331.855553:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1788330331.855567:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1788330331.855581:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788330331.855598:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1788330331.855612:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1788330331.855643:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792437888:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788330331.855708:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330331.856132:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc1088c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788330331.856409:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792437888 00000100:00100000:3.0:1788330331.856428:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792437888 00000100:00100000:3.0:1788330331.856473:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788330331.856483:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7790450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:17836:x1875199792437888:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330331.856683:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7790450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:17836:x1875199792437888:12345-0@lo:502:mount.lustre.0 Request processed in 201us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330331.856691:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788330331.856913:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792437888:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788330331.856998:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1788330331.857012:0:17836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788330331.858017:0:17849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330331.858035:0:17849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330331.858048:0:17849:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788330331.858058:0:17849:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99eee721d800 00000020:00000080:1.0:1788330331.858061:0:17849:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788330331.858072:0:17849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330331.858142:0:17849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330331.858145:0:17849:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788330331.858430:0:17849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330331.858434:0:17849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330331.858436:0:17849:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788330331.858440:0:17849:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99eee721d800 00000020:00000080:1.0:1788330331.858443:0:17849:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788330331.858579:0:17849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330331.858583:0:17849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330331.858585:0:17849:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788330331.858587:0:17849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330331.858589:0:17849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330331.858591:0:17849:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788330331.858595:0:17849:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99eee721d800 00000020:00000080:1.0:1788330331.858597:0:17849:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788330331.862234:0:17849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330331.862254:0:17849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330331.862257:0:17849:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788330331.862262:0:17849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330331.862268:0:17849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330331.862270:0:17849:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788330331.862276:0:17849:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99eee721d800 00000020:00000080:1.0:1788330331.862279:0:17849:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788330331.862370:0:17849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330331.862374:0:17849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330331.862375:0:17849:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788330331.862379:0:17849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1788330331.862675:0:17836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788330331.862722:0:17836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788330331.862751:0:17836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd2174 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd217b expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.862765:0:17836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd2174 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd217b expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330331.862844:0:17836:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788330331.862848:0:17836:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99eee721d800 10000000:01000000:0.0:1788330331.862852:0:17836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99eee721d800 10000000:01000000:0.0:1788330331.862858:0:17836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788330331.862866:0:17836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99eee721d800 from 1 10000000:01000000:0.0:1788330331.862869:0:17836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788330331.862927:0:17836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1326e00/0x8475908e9fd2182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.862937:0:17836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec1326e00/0x8475908e9fd2182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.862951:0:17836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec1326e00/0x8475908e9fd2182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330331.862985:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792438016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788330331.863108:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330331.863317:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792438016 00000100:00100000:0.0:1788330331.863327:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792438016 00000100:00100000:0.0:1788330331.863389:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788330331.863402:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:17836:x1875199792438016:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330331.863422:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330331.863440:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec1327600/0x8475908e9fd2189 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2182 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.863481:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec1327600/0x8475908e9fd2189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2182 expref: 18 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.863493:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec1327600/0x8475908e9fd2189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2182 expref: 18 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.863504:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327600, rc 0) 00000100:00100000:0.0:1788330331.863549:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17836:x1875199792438016:12345-0@lo:101:mount.lustre.0 Request processed in 149us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330331.863557:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788330331.863618:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eed0050f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788330331.863647:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792438016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330331.863667:0:17836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec1326e00/0x8475908e9fd2182 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2189 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.863678:0:17836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec1326e00/0x8475908e9fd2182 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2189 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788330331.884429:0:17836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788330331.884978:0:17836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788330331.888771:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788330331.888887:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1788330331.888912:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1788330331.888929:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1788330331.888944:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1788330331.888961:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1788330331.888975:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1788330331.888991:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1788330331.889019:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1788330331.889036:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1788330331.889081:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1788330331.889100:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1788330331.889115:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1788330331.889130:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1788330331.889146:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1788330331.889178:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1788330331.889194:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1788330331.890862:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1788330331.890907:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1788330331.890923:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1788330331.890939:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1788330331.890951:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1788330331.890965:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1788330331.890982:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1788330331.890997:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1788330331.891014:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1788330331.891062:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1788330331.891090:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1788330331.891126:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1788330331.891133:0:17836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788330331.893465:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792438144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330331.893574:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330331.893639:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec55dca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330331.894125:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792438144 00000100:00100000:3.0:1788330331.894136:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792438144 00000100:00100000:3.0:1788330331.894347:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788330331.894361:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17836:x1875199792438144:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330331.894571:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17836:x1875199792438144:12345-0@lo:501:mount.lustre.0 Request processed in 213us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330331.894580:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788330331.898413:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792438144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330331.898505:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792438272:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330331.898612:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330331.898667:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792438272 00000100:00100000:0.0:1788330331.908841:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792438272 00000100:00100000:0.0:1788330331.908943:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788330331.908956:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17836:x1875199792438272:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330331.909218:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17836:x1875199792438272:12345-0@lo:503:mount.lustre.0 Request processed in 264us (10605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330331.909228:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788330331.909318:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec55dca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788330331.909351:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792438272:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788330331.909912:0:17836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788330331.910011:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792438400:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330331.910075:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330331.910100:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec55dca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330331.910606:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792438400 00000100:00100000:3.0:1788330331.910615:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792438400 00000100:00100000:3.0:1788330331.910661:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788330331.910678:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc661f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17836:x1875199792438400:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330331.910789:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc661f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17836:x1875199792438400:12345-0@lo:502:mount.lustre.0 Request processed in 112us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330331.910797:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788330331.910848:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792438400:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788330331.911057:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788330331.911093:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1788330331.911106:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1788330331.911117:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1788330331.911128:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1788330331.911138:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1788330331.911184:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1788330331.911557:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1788330331.911583:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1788330331.911594:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1788330331.911618:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1788330331.911630:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1788330331.911640:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1788330331.911651:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1788330331.911661:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1788330331.912182:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1788330331.912319:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1788330331.912341:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1788330331.912352:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1788330331.912362:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1788330331.912373:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1788330331.912384:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1788330331.912394:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1788330331.912406:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1788330331.912416:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1788330331.912426:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1788330331.912449:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1788330331.912460:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1788330331.912471:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1788330331.912481:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1788330331.912491:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1788330331.912502:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1788330331.912512:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1788330331.912522:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1788330331.912533:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1788330331.912543:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1788330331.912553:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1788330331.912564:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1788330331.912574:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1788330331.912593:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1788330331.912604:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1788330331.912615:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1788330331.912633:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1788330331.912645:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1788330331.912656:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1788330331.914391:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1788330331.914491:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1788330331.914510:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1788330331.914591:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792438528:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330331.916545:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330331.916617:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792438528 00000100:00100000:3.0:1788330331.916629:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792438528 00000100:00100000:3.0:1788330331.917457:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788330331.917473:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc661c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17836:x1875199792438528:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330331.918766:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc661c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17836:x1875199792438528:12345-0@lo:502:mount.lustre.0 Request processed in 199us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330331.918783:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788330331.918876:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee733e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788330331.918910:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792438528:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788330331.920690:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1788330331.920750:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1788330331.920807:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792438656:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330331.920904:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330331.924607:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee733e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788330331.930072:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792438656 00000100:00100000:0.0:1788330331.930103:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792438656 00000100:00100000:0.0:1788330331.930448:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788330331.930464:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17836:x1875199792438656:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330331.931353:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17836:x1875199792438656:12345-0@lo:502:mount.lustre.0 Request processed in 889us (10443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330331.931364:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788330331.936900:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792438656:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788330331.937064:0:17836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1788330331.937401:0:17836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788330331.939629:0:17855:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788330331.939658:0:17855:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff99eef5834d28) 00000020:00000080:0.0:1788330331.939694:0:17855:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788330331.939828:0:17855:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99eee721d800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788330331.939835:0:17855:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99eee721d800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788330331.939838:0:17855:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eee721d800 3 00010000:00080000:0.0:1788330331.939885:0:17855:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99eededb3800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.150@tcp at head 00010000:00010000:0.0:1788330331.946090:0:17855:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788330331.953711:0:17855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788330331.953784:0:17855:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788330331.953803:0:17855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x8475908e9fd2197 00000100:00080000:1.0:1788330331.953819:0:17855:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788330331.953842:0:17855:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99eededb3800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330331.953894:0:17855:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7e76a00 x1875199792438784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788330331.953930:0:17855:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788330331.954049:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875199792438784:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788330331.954184:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788330331.955350:0:17855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1788330331.955416:0:17836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788330331.955455:0:17836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788330331.955473:0:17836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1326e00/0x8475908e9fd2182 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2189 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330331.955485:0:17836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec1326e00/0x8475908e9fd2182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2189 expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788330331.955549:0:17836:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788330331.955551:0:17836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788330331.955553:0:17836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330331.955554:0:17836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330331.955555:0:17836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330331.955556:0:17836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330331.955558:0:17836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788330331.955560:0:17836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330331.955561:0:17836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788330331.955566:0:17836:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788330331.955569:0:17836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788330331.955570:0:17836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788330331.955571:0:17836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330331.955572:0:17836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330331.955573:0:17836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330331.955574:0:17836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330331.955575:0:17836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788330331.955576:0:17836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330331.955577:0:17836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788330331.955601:0:17836:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788330331.955622:0:17836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792438912:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788330331.955691:0:17836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330331.955731:0:17836:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10880c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330331.956384:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792438912 00000100:00100000:3.0:1788330331.956396:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792438912 00000100:00100000:3.0:1788330331.956479:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788330331.956492:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17836:x1875199792438912:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788330331.956527:0:17097:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788330331.956560:0:17097:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1788330331.961851:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330331.961872:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788330331.961876:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330331.961879:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788330331.961911:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792438784 00000100:00100000:0.0:1788330331.961924:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792438784 00000100:00100000:0.0:1788330331.961981:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788330331.961992:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875199792438784:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788330331.962029:0:17105:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:0.0:1788330331.962095:0:17105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x8475908e9fd219e 00000004:00100000:0.0:1788330331.962117:0:17105:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788330331.962187:0:17105:0:(import.c:65:import_set_state_nolock()) ffff99eededb1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330331.962430:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875199792438784:12345-0@lo:38:llog_process_th.0 Request processed in 437us (8244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330331.962439:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788330331.962645:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99edc7e76a00 x1875199792438784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788330341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330331.962659:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788330331.962669:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788330331.962679:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788330331.962684:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788330331.962687:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eededb3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788330331.962694:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875199792438784:0@lo:38:llog_process_th.0 00000001:00100000:2.0:1788330331.964902:0:17083:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788330331.967595:0:17097:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788330331.967619:0:17097:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788330331.968035:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17836:x1875199792438912:12345-0@lo:253:mount.lustre.0 Request processed in 11537us (12335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330331.968084:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 20000000:01000000:3.0:1788330331.968393:0:17119:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788330331.968400:0:17119:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788330331.968429:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99eec147ba00/0x8475908e9fd21a5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330331.968448:0:17119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eec147b000/0x8475908e9fd20a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd20a2 expref: 17 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330331.968457:0:17119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eec9038000/0x8475908e9fd216d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2166 expref: 17 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330331.968466:0:17119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99eec147ba00/0x8475908e9fd21a5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330331.968520:0:17119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eec9038000/0x8475908e9fd216d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd2166 expref: 17 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330331.968536:0:17119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eec9038000/0x8475908e9fd216d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd2166 expref: 17 pid: 17098 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330331.968553:0:17119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1875199792439040:0@lo:104: 00000100:00100000:3.0:1788330331.968606:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788330331.968669:0:17119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eec147b000/0x8475908e9fd20a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd20a2 expref: 17 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330331.968690:0:17119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eec147b000/0x8475908e9fd20a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd20a2 expref: 17 pid: 17097 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330331.968699:0:17119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1875199792439168:0@lo:104: 00000100:00100000:3.0:1788330331.968722:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330331.968743:0:17119:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec29e03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330331.968770:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792439040 00000100:00100000:3.0:1788330331.968778:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792439040 00000100:00100000:3.0:1788330331.968818:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792439168 00000100:00100000:3.0:1788330331.968820:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792439168 00000100:00100000:3.0:1788330331.968835:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788330331.968845:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+4:17119:x1875199792439040:12345-0@lo:104: 00010000:00010000:3.0:1788330331.968861:0:17086:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec1327e00/0x8475908e9fd2166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd216d expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330331.968910:0:17086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788330331.968916:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+4:17119:x1875199792439040:12345-0@lo:104: Request processed in 73us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330331.968923:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788330331.968939:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788330331.968944:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+3:17119:x1875199792439168:12345-0@lo:104: 00010000:00010000:3.0:1788330331.968952:0:17086:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd20a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd20a9 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330331.968981:0:17086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788330331.968986:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+3:17119:x1875199792439168:12345-0@lo:104: Request processed in 43us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330331.969001:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788330331.969017:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330331.969024:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec1327e00/0x8475908e9fd2166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd216d expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330331.969032:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327e00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330331.969036:0:17091:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec1327e00/0x8475908e9fd2166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd216d expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330331.969060:0:17091:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec1327e00/0x8475908e9fd2166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd216d expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330331.969068:0:17091:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec1327e00/0x8475908e9fd2166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd216d expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330331.969083:0:17091:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788330331.969116:0:17091:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec1327e00/0x8475908e9fd2166 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd216d expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330331.969123:0:17091:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330331.969178:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec1327e00/0x8475908e9fd2166 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd216d expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330331.969185:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec1327e00/0x8475908e9fd2166 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd216d expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330331.969398:0:17836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17836:1875199792438912:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788330331.969414:0:17836:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788330331.969418:0:17836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788330331.969420:0:17836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788330331.969421:0:17836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788330331.969423:0:17836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788330331.969424:0:17836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788330331.969425:0:17836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788330331.969427:0:17836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788330331.969429:0:17836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788330331.969431:0:17836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788330331.969448:0:17836:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788330331.971500:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330331.971713:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330331.971717:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330331.971719:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330331.971758:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792439296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330331.971858:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330331.972007:0:17119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1875199792439040:0@lo:104: 00000100:00100000:3.0:1788330331.972021:0:17119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1875199792439168:0@lo:104: 00010000:00010000:3.0:1788330331.972060:0:17119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99eec147ba00/0x8475908e9fd21a5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330331.975581:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330331.975588:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330331.975591:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330331.978363:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792439296 00000100:00100000:0.0:1788330331.978386:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792439296 00010000:00010000:0.0:1788330331.978441:0:17088:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eec9038000/0x8475908e9fd216d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2166 expref: 18 pid: 17098 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330331.978492:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788330331.978505:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:3648:x1875199792439296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330331.978523:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330331.978529:0:17088:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eec9038000/0x8475908e9fd216d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2166 expref: 18 pid: 17098 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.978545:0:17088:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eec9038000/0x8475908e9fd216d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd2166 expref: 18 pid: 17098 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.978567:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec9038000/0x8475908e9fd216d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd2166 expref: 18 pid: 17098 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.978587:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330331.978694:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:3648:x1875199792439296:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (6836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330331.978702:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788330331.978982:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792439296:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330331.981909:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd20a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd20a9 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330331.981933:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7eec00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:1.0:1788330331.981939:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd20a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd20a9 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330331.981950:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd20a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd20a9 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788330331.981959:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd20a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd20a9 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330331.981964:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788330331.982060:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd20a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd20a9 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330331.982068:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788330331.982186:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd20a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd20a9 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330331.982194:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eefe7eec00/0x8475908e9fd20a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd20a9 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330331.982333:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3649:1875199792439424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330331.982430:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330331.982536:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792439424 00000100:00100000:0.0:1788330331.982559:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792439424 00010000:00010000:0.0:1788330331.982601:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eec147b000/0x8475908e9fd20a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd20a2 expref: 17 pid: 17097 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330331.982638:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788330331.982650:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:3649:x1875199792439424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330331.982666:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330331.982672:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eec147b000/0x8475908e9fd20a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd20a2 expref: 17 pid: 17097 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.982687:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eec147b000/0x8475908e9fd20a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd20a2 expref: 17 pid: 17097 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.982706:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec147b000/0x8475908e9fd20a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd20a2 expref: 17 pid: 17097 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.982725:0:17090:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99eec147ba00/0x8475908e9fd21a5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.982734:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec147ba00/0x8475908e9fd21a5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788330331.982754:0:17090:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014354416s 00010000:00010000:0.0:1788330331.982759:0:17090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eec147ba00/0x8475908e9fd21a5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.982767:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eec147ba00/0x8475908e9fd21a5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.982774:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99eec147ba00/0x8475908e9fd21a5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.982791:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99eec147ba00/0x8475908e9fd21a5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.982797:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147ba00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330331.982802:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99eec147ba00/0x8475908e9fd21a5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.982811:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99eec147ba00/0x8475908e9fd21a5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.982826:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99eec147ba00/0x8475908e9fd21a5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.982837:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330331.982874:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+16:3649:x1875199792439424:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330331.982882:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788330331.982911:0:17119:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99eec147ba00/0x8475908e9fd21a5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.982919:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99eec147ba00/0x8475908e9fd21a5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330331.982926:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec147ba00/0x8475908e9fd21a5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330331.982961:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3649:1875199792439424:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330331.983181:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330331.983183:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330331.983185:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788330332.002050:0:17836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788330332.003425:0:17861:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788330332.003434:0:17861:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788330332.003513:0:17862:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788330332.003915:0:17836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788330332.004790:0:17863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17863:1875199792439552:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788330332.004892:0:17863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330332.004936:0:17863:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee76e79c0 going to sleep for 11 seconds 00000040:01000000:2.0:1788330332.005190:0:17836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788330332.005428:0:17836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788330332.005861:0:17836:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788330332.005869:0:17836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788330332.005903:0:17836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788330332.006623:0:17862:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788330332.008100:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792439552 00000100:00100000:1.0:1788330332.008134:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792439552 00000100:00100000:1.0:1788330332.008406:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788330332.008420:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17863:x1875199792439552:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788330332.008591:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17863:x1875199792439552:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 175us (3700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330332.008600:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788330332.008961:0:17863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17863:1875199792439552:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788330332.009028:0:17863:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788330332.009106:0:17863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17863:1875199792439680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788330332.009183:0:17863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330332.010443:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792439680 00000100:00100000:1.0:1788330332.010458:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792439680 00000100:00100000:1.0:1788330332.010521:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788330332.010534:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17863:x1875199792439680:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788330332.011336:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17863:x1875199792439680:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 799us (2146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330332.011347:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000040:00080000:2.0:1788330332.012138:0:17836:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788330332.013388:0:17862:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788330332.013488:0:17862:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1788330332.016401:0:17836:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788330332.016459:0:17836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788330332.016624:0:17836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788330332.024239:0:17863:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee76e79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330332.024307:0:17863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17863:1875199792439680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788330332.024445:0:17863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17863:1875199792439808:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788330332.024529:0:17863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330332.024556:0:17863:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee76e7300 going to sleep for 11 seconds 00000100:00100000:2.0:1788330332.024725:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792439808 00000100:00100000:2.0:1788330332.024734:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792439808 00000100:00100000:2.0:1788330332.024789:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788330332.024802:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17863:x1875199792439808:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788330332.024875:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17863:x1875199792439808:12345-0@lo:900:lod0001_rec0000.0 Request processed in 76us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330332.024884:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788330332.025025:0:17863:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99eefd32df80 x1875199792439808/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788330348 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330332.025049:0:17863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17863:1875199792439808:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788330332.025267:0:17863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17863:1875199792439936:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788330332.025305:0:17863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:3.0:1788330332.025849:0:17836:0:(osd_handler.c:5583:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:0.0:1788330332.026096:0:17863:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee76e79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330332.026920:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792439936 00000100:00100000:1.0:1788330332.026932:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792439936 00000001:00000004:3.0:1788330332.028906:0:17836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788330332.032996:0:17836:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788330332.033060:0:17836:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb7bcc1a87988 00100000:10000000:3.0:1788330332.033320:0:17836:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788330332.034960:0:17836:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788330332.035169:0:17836:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.150@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788330332.035195:0:17836:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788330332.035427:0:17836:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788330332.040713:0:17836:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788330332.041016:0:17836:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788330332.042428:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788330332.042446:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17863:x1875199792439936:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788330332.042626:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17863:x1875199792439936:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 185us (17320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330332.042635:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788330332.049128:0:17863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32df80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17863:1875199792439936:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788330332.049420:0:17863:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788330332.059906:0:17863:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788330332.060021:0:17863:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788330332.060027:0:17863:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000100:00100000:0.0:1788330332.193773:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 00010000:00010000:3.0:1788330332.764436:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788330332.957736:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788330333.211345:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 10000000:01000000:3.0:1788330333.339614:0:17101:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788330333.339625:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99eee721d800 from 8 10000000:01000000:3.0:1788330333.339632:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788330333.339699:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd21ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330333.339714:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd21ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330333.339745:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd21ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330333.339779:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792440064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788330333.339872:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330333.340347:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792440064 00000100:00100000:0.0:1788330333.340359:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792440064 00000100:00100000:3.0:1788330333.340398:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec2a9ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330333.340487:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788330333.340503:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+16:17101:x1875199792440064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330333.340522:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330333.340539:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec9039400/0x8475908e9fd21b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd21ac expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330333.340570:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9039400/0x8475908e9fd21b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd21ac expref: 17 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330333.340585:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec9039400/0x8475908e9fd21b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd21ac expref: 17 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330333.340594:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039400, rc 0) 00000100:00100000:2.0:1788330333.340649:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:17101:x1875199792440064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330333.340669:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788330333.342062:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792440064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330333.342094:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd21ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd21b3 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330333.342109:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd21ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd21b3 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330333.342233:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792440192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788330333.342300:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330333.342337:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec2a9ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330333.342506:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792440192 00000100:00100000:0.0:1788330333.342513:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792440192 00000100:00100000:0.0:1788330333.342580:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788330333.342590:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:17101:x1875199792440192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788330333.342624:0:17097:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788330333.342641:0:17097:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788330333.342644:0:17097:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788330333.342750:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:17101:x1875199792440192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 160us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330333.342759:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788330333.343008:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792440192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788330333.343076:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788330333.343086:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd21ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd21b3 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330333.343097:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd21ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd21b3 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330333.343110:0:17101:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788330333.343113:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99edc7d05800 from 8 10000000:01000000:3.0:1788330333.343122:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788330333.343178:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd21ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330333.343188:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd21ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330333.343208:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd21ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330333.343224:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792440320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788330333.343252:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330333.343281:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec2a9ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330333.343332:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792440320 00000100:00100000:2.0:1788330333.343338:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792440320 00000100:00100000:2.0:1788330333.343365:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788330333.343372:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:17101:x1875199792440320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330333.343381:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330333.343397:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec9038800/0x8475908e9fd21c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd21ba expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330333.343419:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9038800/0x8475908e9fd21c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd21ba expref: 18 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330333.343431:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec9038800/0x8475908e9fd21c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd21ba expref: 18 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330333.343442:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038800, rc 0) 00000100:00100000:2.0:1788330333.343480:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17101:x1875199792440320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330333.343487:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788330333.343603:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792440320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330333.343615:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd21ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd21c1 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330333.343624:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd21ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd21c1 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330333.343666:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792440448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788330333.343696:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330333.343814:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec2a9ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330333.343870:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792440448 00000100:00100000:0.0:1788330333.343874:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792440448 00000100:00100000:0.0:1788330333.343904:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788330333.343911:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17101:x1875199792440448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788330333.343924:0:17097:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788330333.343936:0:17097:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788330333.343940:0:17097:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788330333.344036:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17101:x1875199792440448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330333.344044:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788330333.344230:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792440448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788330333.344274:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788330333.344282:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd21ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd21c1 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330333.344302:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd21ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd21c1 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330333.788269:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788330333.984010:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788330334.236204:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 00010000:00010000:2.0:1788330334.813989:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330335.259304:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 00010000:00010000:3.0:1788330335.836658:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330336.285221:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 0 seconds 00010000:00010000:2.0:1788330336.863864:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330337.179305:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792440576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330337.179389:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330337.179467:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792440576 00000100:00100000:1.0:1788330337.180570:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792440576 00000100:00100000:1.0:1788330337.180634:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788330337.180643:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792440576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788330337.180685:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788330337.180753:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792440576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330337.180761:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788330337.180818:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792440576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330337.183274:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1788330337.183829:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788330337.183835:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788330337.183839:0:37:0:(import.c:65:import_set_state_nolock()) ffff99edc759f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330337.183850:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 535 00000100:00080000:1.0:1788330337.183856:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788330337.183864:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99edc759f800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330337.183895:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7e76680 x1875199792440832/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788330337.183914:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330337.183924:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788330337.183927:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330337.183931:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788330337.183956:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330337.183960:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788330337.183963:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330337.183967:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788330337.184012:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792440832:0@lo:38:kworker.0 00000100:00100000:1.0:1788330337.184096:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330337.184190:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792440832 00000100:00100000:1.0:1788330337.184198:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792440832 00000100:00100000:1.0:1788330337.184237:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788330337.184247:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875199792440832:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788330337.184278:0:17109:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:1.0:1788330337.184325:0:17109:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd21c8 00000004:00100000:1.0:1788330337.184345:0:17109:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788330337.184351:0:17109:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1788330337.192559:0:17109:0:(import.c:65:import_set_state_nolock()) ffff99eededf5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788330337.192766:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875199792440832:12345-0@lo:38:kworker.0 Request processed in 8515us (8666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330337.192780:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788330337.193373:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788330337.193402:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788330337.193413:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788330337.193421:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788330337.193424:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc759f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788330337.193466:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000143cc793): req@ffff99eefd32d180 x1875199792433664/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330337.193984:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792440832:0@lo:38:kworker.0 00000100:00100000:0.0:1788330337.194875:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792441216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330337.194955:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792441088:0@lo:400:kworker.0 00000100:00100000:0.0:1788330337.194969:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330337.199023:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330337.200295:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330337.200311:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792440960:0@lo:400:kworker.0 00000100:00100000:3.0:1788330337.200387:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330337.203273:0:17145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330337.203344:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788330337.203387:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792441216 00000100:00100000:2.0:1788330337.203397:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792441216 00000100:00100000:2.0:1788330337.203442:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792433664 00000100:00100000:2.0:1788330337.203445:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792433664 00000100:00100000:2.0:1788330337.203460:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788330337.206129:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792441088 00000100:00100000:1.0:1788330337.206167:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792441088 00000100:00100000:1.0:1788330337.206231:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792440960 00000100:00100000:1.0:1788330337.206235:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792440960 00000100:00100000:1.0:1788330337.206256:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788330337.206267:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792441088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330337.206394:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792441088:12345-0@lo:400:kworker.0 Request processed in 128us (7386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330337.206416:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788330337.206436:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788330337.206441:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792440960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330337.206475:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792440960:12345-0@lo:400:kworker.0 Request processed in 33us (6087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330337.206481:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788330337.206541:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99edc7e77b80 x1875199792440960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330337.206558:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792440960:0@lo:400:kworker.0 00010000:00080000:1.0:1788330337.206576:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99edc7e74380 x1875199792441088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330337.206584:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792441088:0@lo:400:kworker.0 00000100:00100000:2.0:1788330337.208483:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1875199792441216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788330337.208546:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788330337.208654:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1875199792441216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 185us (13685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330337.208770:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788330337.208821:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788330337.208829:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17145:x1875199792433664:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788330337.208919:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17145:x1875199792433664:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 90us (5654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330337.208926:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788330337.211201:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792441216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330337.211223:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792440704:0@lo:400:kworker.0 00000100:00100000:0.0:1788330337.211299:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330337.211336:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792440704 00000100:00100000:0.0:1788330337.211345:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792440704 00000100:00100000:0.0:1788330337.211419:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788330337.211429:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:3646:x1875199792440704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330337.211484:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:3646:x1875199792440704:12345-0@lo:400:kworker.0 Request processed in 57us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330337.211492:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788330337.211543:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792440704:0@lo:400:kworker.0 00000100:00100000:3.0:1788330337.212438:0:17145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32d180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17145:1875199792433664:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788330337.212490:0:17145:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788330337.214724:0:17145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17145:1875199792441344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788330337.215078:0:17145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330337.215287:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee74ff180 going to sleep for 11 seconds 00000100:00100000:2.0:1788330337.215394:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792441344 00000100:00100000:2.0:1788330337.215405:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792441344 00000100:00100000:2.0:1788330337.215476:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788330337.215487:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17145:x1875199792441344:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788330337.215985:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17145:x1875199792441344:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 498us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330337.216003:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788330337.216113:0:17145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17145:1875199792441344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788330337.216354:0:17145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17145:1875199792441472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788330337.216391:0:17145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330337.216457:0:17145:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee74ff540 going to sleep for 11 seconds 00000100:00100000:2.0:1788330337.216637:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792441472 00000100:00100000:2.0:1788330337.216644:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792441472 00000100:00100000:2.0:1788330337.216673:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788330337.216682:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17145:x1875199792441472:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788330337.216801:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17145:x1875199792441472:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 120us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330337.216808:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788330337.216917:0:17145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17145:1875199792441472:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788330337.217123:0:17145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788330337.220879:0:17145:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788330337.221062:0:17145:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 22, retries 0 00000004:00080000:3.0:1788330337.221070:0:17145:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:1.0:1788330337.284082:0:18105:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1788330337.310487:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788330337.887810:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788330338.693914:0:18158:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788330338.694702:0:18158:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788330338.914048:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330339.942771:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330340.252278:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330325/real 1788330325] req@ffff99edc5ee8e00 x1875199792434688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330340 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330340.252321:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99edc5ee8e00 x1875199792434688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330340 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330340.252331:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330325/real 1788330325] req@ffff99edc5ee8000 x1875199792434816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330340 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330340.252340:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99edc5ee8000 x1875199792434816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330340 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788330340.252362:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eee7217000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788330340.252392:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788330340.252396:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792434688:0@lo:8:kworker.0 00000100:00080000:3.0:1788330340.252401:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eee721f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788330340.252406:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788330340.252409:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792434816:0@lo:8:kworker.0 00000100:00080000:1.0:1788330340.252589:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330340.252595:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788330340.252598:0:36:0:(import.c:65:import_set_state_nolock()) ffff99eee7217000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330340.252603:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 529 00000100:00080000:1.0:1788330340.252609:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788330340.252617:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99eee7217000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330340.252641:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7e75500 x1875199792441856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788330340.252653:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330340.252671:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788330340.252673:0:36:0:(import.c:65:import_set_state_nolock()) ffff99eee721f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330340.252677:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 529 00000100:00080000:1.0:1788330340.252680:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788330340.252686:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99eee721f000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330340.252715:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7e75f80 x1875199792441984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788330340.252738:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330340.252741:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788330340.252744:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330340.252747:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788330340.252778:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792442112:0@lo:400:kworker.0 00000100:00100000:1.0:1788330340.252862:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330340.252903:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330340.252910:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792441728:0@lo:400:kworker.0 00000100:00100000:1.0:1788330340.252939:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330340.252992:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792442112 00000100:00100000:1.0:1788330340.253001:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792442112 00000100:00100000:1.0:1788330340.253058:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788330340.253070:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792442112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330340.253138:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792442112:12345-0@lo:400:kworker.0 Request processed in 58us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330340.253145:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788330340.253213:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99edc7e75c00 x1875199792442112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330340.253239:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792442112:0@lo:400:kworker.0 00000100:00100000:3.0:1788330340.254201:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3647:1875199792441600:0@lo:400:kworker.0 00000100:00100000:3.0:1788330340.254258:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330340.254302:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792442368:0@lo:400:kworker.0 00000100:00100000:3.0:1788330340.254327:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330340.254351:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788330340.254357:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792442240:0@lo:400:kworker.0 00000100:00100000:3.0:1788330340.254400:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330340.254441:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792442368 00000100:00100000:3.0:1788330340.254448:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792442368 00000100:00100000:3.0:1788330340.254486:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788330340.254494:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792442368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330340.254538:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792442368:12345-0@lo:400:kworker.0 Request processed in 45us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330340.254545:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788330340.254569:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792441728 00000100:00100000:3.0:1788330340.254572:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792441728 00000100:00100000:3.0:1788330340.254589:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792442240 00000100:00100000:3.0:1788330340.254592:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792442240 00000100:00100000:3.0:1788330340.254605:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788330340.254611:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875199792441728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330340.254650:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875199792441728:12345-0@lo:400:kworker.0 Request processed in 39us (1710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330340.254656:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788330340.254667:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788330340.254673:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792442240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330340.254716:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792442240:12345-0@lo:400:kworker.0 Request processed in 44us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330340.254722:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788330340.254742:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792441856:0@lo:8:kworker.0 00000400:00000100:3.0:1788330340.254766:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199792441856 offset 0 length 520: 4 00000100:00100000:3.0:1788330340.254782:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792441984:0@lo:8:kworker.0 00000400:00000100:3.0:1788330340.254798:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199792441984 offset 0 length 520: 4 00000100:00100000:3.0:1788330340.254848:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792442240:0@lo:400:kworker.0 00010000:00080000:3.0:1788330340.254861:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99edc7e76680 x1875199792442368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330340.254871:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792442368:0@lo:400:kworker.0 00000100:00100000:3.0:1788330340.254902:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792441728:0@lo:400:kworker.0 00000100:00100000:1.0:1788330340.255133:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792441600 00000100:00100000:1.0:1788330340.255139:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792441600 00000100:00100000:1.0:1788330340.255199:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788330340.255207:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:3647:x1875199792441600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330340.255244:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:3647:x1875199792441600:12345-0@lo:400:kworker.0 Request processed in 39us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330340.255251:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788330340.255345:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3647:1875199792441600:0@lo:400:kworker.0 00000020:00000004:0.0:1788330340.277638:0:18208:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788330340.277955:0:18208:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788330340.955927:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330341.287859:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330331/real 1788330331] req@ffff99edc5eeb100 x1875199792436992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330341 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330341.287968:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99edc5eeb100 x1875199792436992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330341 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330341.287979:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330331/real 1788330331] req@ffff99edc5ee9880 x1875199792436864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330341 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330341.288105:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99edc5ee9880 x1875199792436864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330341 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788330341.288429:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7e25800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788330341.288458:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788330341.288464:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792436992:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788330341.288470:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eec289b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788330341.288476:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788330341.288479:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792436864:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788330341.289308:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330341.289315:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788330341.289318:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330341.289321:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788330341.289354:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330341.289357:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788330341.289361:0:37:0:(import.c:65:import_set_state_nolock()) ffff99eec289b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330341.289368:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 535 00000100:00080000:2.0:1788330341.289375:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788330341.289383:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99eec289b000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330341.289406:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc5ee8000 x1875199792443008/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788330341.289420:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330341.289423:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788330341.289425:0:37:0:(import.c:65:import_set_state_nolock()) ffff99edc7e25800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330341.289428:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 535 00000100:00080000:2.0:1788330341.289431:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788330341.289435:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99edc7e25800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:2.0:1788330341.289447:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc5ee8e00 x1875199792443136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788330341.289486:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792442752:0@lo:400:kworker.0 00000100:00100000:2.0:1788330341.289581:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330341.289623:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330341.289629:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792442880:0@lo:400:kworker.0 00000100:00100000:2.0:1788330341.289671:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330341.290106:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792442496:0@lo:400:kworker.0 00000100:00100000:3.0:1788330341.290186:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330341.290222:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792443264:0@lo:400:kworker.0 00000100:00100000:3.0:1788330341.290247:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330341.290268:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330341.290275:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792442624:0@lo:400:kworker.0 00000100:00100000:3.0:1788330341.290299:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330341.290332:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792443008:0@lo:8:kworker.0 00000400:00000100:3.0:1788330341.290352:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199792443008 offset 0 length 520: 4 00000100:00100000:3.0:1788330341.290365:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792443136:0@lo:8:kworker.0 00000400:00000100:3.0:1788330341.290379:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199792443136 offset 0 length 520: 4 00000100:00100000:3.0:1788330341.290407:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792442880 00000100:00100000:3.0:1788330341.290416:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792442880 00000100:00100000:3.0:1788330341.290460:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792442624 00000100:00100000:3.0:1788330341.290464:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792442624 00000100:00100000:3.0:1788330341.290484:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788330341.290495:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792442880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330341.290557:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792442880:12345-0@lo:400:kworker.0 Request processed in 64us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330341.290564:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788330341.290581:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788330341.290587:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875199792442624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330341.290617:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875199792442624:12345-0@lo:400:kworker.0 Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330341.290623:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788330341.290638:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792442752 00000100:00100000:3.0:1788330341.290649:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792442752 00000100:00100000:3.0:1788330341.290673:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792443264 00000100:00100000:3.0:1788330341.290675:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792443264 00000100:00100000:3.0:1788330341.290688:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788330341.290694:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792442752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330341.290726:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792442752:12345-0@lo:400:kworker.0 Request processed in 32us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330341.290732:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788330341.290743:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788330341.290749:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792443264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330341.290775:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792443264:12345-0@lo:400:kworker.0 Request processed in 26us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330341.290781:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788330341.290824:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792442624:0@lo:400:kworker.0 00010000:00080000:3.0:1788330341.290839:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99edc5ee9180 x1875199792443264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330341.290849:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792443264:0@lo:400:kworker.0 00000100:00100000:3.0:1788330341.290883:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792442880:0@lo:400:kworker.0 00010000:00080000:3.0:1788330341.290894:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99edc5ee9880 x1875199792442752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330341.290903:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792442752:0@lo:400:kworker.0 00000100:00100000:0.0:1788330341.291683:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792442496 00000100:00100000:0.0:1788330341.291701:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792442496 00000100:00100000:0.0:1788330341.291758:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788330341.291768:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:3648:x1875199792442496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330341.291838:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:3648:x1875199792442496:12345-0@lo:400:kworker.0 Request processed in 72us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330341.291845:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788330341.292725:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792442496:0@lo:400:kworker.0 00000020:00000080:3.0:1788330341.949630:0:18256:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe37cbef30 20000000:00000080:3.0:1788330341.949655:0:18256:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99eec89f9c00 uarg=0000000000000000 20000000:01000000:3.0:1788330341.949728:0:18256:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788330341.949739:0:18256:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788330341.949746:0:18256:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788330341.951659:0:18257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1788330341.951856:0:18256:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788330341.968193:0:18256:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788330341.968577:0:18256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99eefe7ef000/0x8475908e9fd21cf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330341.968603:0:18256:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eec9038400/0x8475908e9fd2078 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2071 expref: 17 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330341.968612:0:18256:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eec1326c00/0x8475908e9fd217b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2174 expref: 17 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330341.968620:0:18256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99eefe7ef000/0x8475908e9fd21cf lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330341.968677:0:18256:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eec1326c00/0x8475908e9fd217b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd2174 expref: 17 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330341.968697:0:18256:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eec1326c00/0x8475908e9fd217b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd2174 expref: 17 pid: 17095 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330341.968715:0:18256:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e75c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18256:1875199792443392:0@lo:104: 00000100:00100000:1.0:1788330341.968812:0:18256:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788330341.968897:0:18256:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eec9038400/0x8475908e9fd2078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd2071 expref: 17 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330341.968906:0:18256:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eec9038400/0x8475908e9fd2078 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd2071 expref: 17 pid: 17095 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330341.968914:0:18256:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e75880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18256:1875199792443520:0@lo:104: 00000100:00100000:1.0:1788330341.968938:0:18256:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330341.968974:0:18256:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee733ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330341.969422:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792443392 00000100:00100000:2.0:1788330341.969432:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792443392 00000100:00100000:2.0:1788330341.969484:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792443520 00000100:00100000:2.0:1788330341.969487:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792443520 00000100:00100000:2.0:1788330341.969502:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788330341.969513:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+4:18256:x1875199792443392:12345-0@lo:104: 00010000:00010000:2.0:1788330341.969530:0:17086:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd2174 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd217b expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.969607:0:17086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788330341.969614:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+4:18256:x1875199792443392:12345-0@lo:104: Request processed in 103us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330341.969622:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788330341.969643:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788330341.969649:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+3:18256:x1875199792443520:12345-0@lo:104: 00010000:00010000:2.0:1788330341.969657:0:17086:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd2071 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2078 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.969695:0:17086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788330341.969700:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+3:18256:x1875199792443520:12345-0@lo:104: Request processed in 51us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330341.969706:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788330341.969723:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788330341.969730:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd2174 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd217b expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.969737:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147a800 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:2.0:1788330341.969751:0:17858:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd2174 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd217b expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.969761:0:17858:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd2174 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd217b expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330341.969769:0:17858:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd2174 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd217b expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330341.969775:0:17858:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788330341.969811:0:17858:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd2174 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd217b expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.969818:0:17858:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788330341.969841:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd2174 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd217b expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.969850:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec147a800/0x8475908e9fd2174 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd217b expref: -99 pid: 17836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.969865:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330341.969868:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd2071 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2078 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.969874:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147ae00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:2.0:1788330341.969877:0:17858:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd2071 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd2078 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.969883:0:17858:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd2071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd2078 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330341.969900:0:17858:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd2071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd2078 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330341.969906:0:17858:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788330341.969920:0:17858:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd2071 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2078 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.969926:0:17858:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788330341.969954:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd2071 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2078 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.969961:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec147ae00/0x8475908e9fd2071 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2078 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.969975:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330341.969977:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330341.969978:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330341.970010:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3649:1875199792443648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330341.970057:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330341.970101:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792443776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330341.970124:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330341.970181:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792443648 00000100:00100000:2.0:1788330341.970185:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792443648 00010000:00010000:2.0:1788330341.970205:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eec1326c00/0x8475908e9fd217b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2174 expref: 18 pid: 17095 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330341.970225:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792443776 00000100:00100000:2.0:1788330341.970228:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792443776 00010000:00010000:2.0:1788330341.970237:0:17090:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eec9038400/0x8475908e9fd2078 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2071 expref: 19 pid: 17095 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330341.970257:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788330341.970264:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+19:3649:x1875199792443648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330341.970276:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330341.970282:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eec1326c00/0x8475908e9fd217b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2174 expref: 19 pid: 17095 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.970293:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eec1326c00/0x8475908e9fd217b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd2174 expref: 19 pid: 17095 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.970312:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330341.970341:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+19:3649:x1875199792443648:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330341.970348:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788330341.970364:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788330341.970371:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:3646:x1875199792443776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330341.970377:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330341.970382:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eec9038400/0x8475908e9fd2078 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2071 expref: 18 pid: 17095 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.970390:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eec9038400/0x8475908e9fd2078 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd2071 expref: 18 pid: 17095 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.970402:0:17090:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99eefe7ef000/0x8475908e9fd21cf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.970410:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eefe7ef000/0x8475908e9fd21cf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.970439:0:17090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eefe7ef000/0x8475908e9fd21cf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.970446:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eefe7ef000/0x8475908e9fd21cf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.970453:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99eefe7ef000/0x8475908e9fd21cf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.970458:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99eefe7ef000/0x8475908e9fd21cf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.970463:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330341.970468:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99eefe7ef000/0x8475908e9fd21cf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.970475:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99eefe7ef000/0x8475908e9fd21cf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.970483:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99eefe7ef000/0x8475908e9fd21cf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330341.970492:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330341.970521:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:3646:x1875199792443776:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330341.970528:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788330341.970573:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792443776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330341.970602:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3649:1875199792443648:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330341.970688:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330341.971286:0:18256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec1326c00/0x8475908e9fd217b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd2174 expref: 17 pid: 17095 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330341.971301:0:18256:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e75c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18256:1875199792443392:0@lo:104: 00010000:00010000:1.0:1788330341.971312:0:18256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec9038400/0x8475908e9fd2078 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd2071 expref: 16 pid: 17095 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330341.971321:0:18256:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e75880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18256:1875199792443520:0@lo:104: 00010000:00010000:1.0:1788330341.971340:0:18256:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99eefe7ef000/0x8475908e9fd21cf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330341.971349:0:18256:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99eefe7ef000/0x8475908e9fd21cf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330341.971356:0:18256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99eefe7ef000/0x8475908e9fd21cf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330341.971363:0:18256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eefe7ef000/0x8475908e9fd21cf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330341.994001:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330342.308649:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792443904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330342.308766:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330342.311269:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330342.311304:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792444032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330342.311390:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330342.311453:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792443904 00000100:00100000:0.0:1788330342.311462:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792443904 00000100:00100000:0.0:1788330342.311510:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792444032 00000100:00100000:0.0:1788330342.311513:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792444032 00000100:00100000:0.0:1788330342.311530:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788330342.311554:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875199792443904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330342.311600:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788330342.311660:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875199792443904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (2895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330342.311668:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788330342.311690:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788330342.311696:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792444032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788330342.311713:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788330342.311745:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792444032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330342.311750:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788330342.311796:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792444032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788330342.312428:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792443904:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1788330342.821384:0:17837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788330343.005658:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788330343.198074:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788330343.964222:0:17101:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788330343.964234:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eee721d800 from 13 10000000:01000000:2.0:1788330343.964242:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788330343.964308:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038000/0x8475908e9fd21d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330343.964322:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec9038000/0x8475908e9fd21d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330343.964335:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec9038000/0x8475908e9fd21d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330343.964369:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792444160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788330343.964462:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330343.964518:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc1088480 going to sleep for 11 seconds 00000100:00100000:3.0:1788330343.965188:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792444160 00000100:00100000:3.0:1788330343.965200:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792444160 00000100:00100000:3.0:1788330343.965276:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788330343.965288:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+16:17101:x1875199792444160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330343.965306:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330343.965327:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eeef91bc00/0x8475908e9fd21dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd21d6 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330343.965360:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eeef91bc00/0x8475908e9fd21dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd21d6 expref: 17 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330343.965373:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eeef91bc00/0x8475908e9fd21dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd21d6 expref: 17 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330343.965385:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eeef91bc00, rc 0) 00000100:00100000:3.0:1788330343.965460:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:17101:x1875199792444160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330343.965468:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788330343.965534:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792444160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330343.965553:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec9038000/0x8475908e9fd21d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd21dd expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330343.965562:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec9038000/0x8475908e9fd21d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd21dd expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330343.965655:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792444288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330343.965686:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330343.965712:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee74ff9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330343.965729:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792444288 00000100:00100000:3.0:1788330343.965732:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792444288 00000100:00100000:3.0:1788330343.965760:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788330343.965768:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:17101:x1875199792444288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330343.965893:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:17101:x1875199792444288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330343.965900:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788330343.965942:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792444288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330343.966045:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792444416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330343.966088:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330343.966103:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee74ff9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330343.966117:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792444416 00000100:00100000:3.0:1788330343.966121:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792444416 00000100:00100000:3.0:1788330343.966146:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788330343.966182:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:17101:x1875199792444416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330343.966277:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:17101:x1875199792444416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330343.966284:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788330343.966639:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792444416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788330343.971814:0:18319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788330343.976010:0:17101:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788330343.976075:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788330343.976091:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038000/0x8475908e9fd21d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd21dd expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330343.976119:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec9038000/0x8475908e9fd21d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd21dd expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330343.976135:0:17101:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788330343.976138:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99edc7d05800 from 13 10000000:01000000:3.0:1788330343.976142:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788330343.976217:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eeef91ac00/0x8475908e9fd21e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330343.976226:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eeef91ac00/0x8475908e9fd21e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330343.976239:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eeef91ac00/0x8475908e9fd21e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330343.976272:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792444544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788330343.976359:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330343.976413:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee74ff0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330343.977887:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792444544 00000100:00100000:2.0:1788330343.977903:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792444544 00000100:00100000:2.0:1788330343.977999:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788330343.978014:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+17:17101:x1875199792444544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330343.978043:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330343.978064:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec9038e00/0x8475908e9fd21eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd21e4 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330343.978098:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9038e00/0x8475908e9fd21eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd21e4 expref: 18 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330343.978127:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec9038e00/0x8475908e9fd21eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd21e4 expref: 18 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330343.978139:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038e00, rc 0) 00000100:00100000:2.0:1788330343.978235:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17101:x1875199792444544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330343.978242:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788330343.978675:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792444544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330343.978696:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eeef91ac00/0x8475908e9fd21e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd21eb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330343.978706:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eeef91ac00/0x8475908e9fd21e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd21eb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330343.978799:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792444672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330343.978836:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330343.978886:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee74ff0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330343.979048:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792444672 00000100:00100000:2.0:1788330343.979054:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792444672 00000100:00100000:2.0:1788330343.979090:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788330343.979097:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17101:x1875199792444672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330343.979265:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17101:x1875199792444672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330343.979273:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788330343.979636:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792444672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330343.979678:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792444800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330343.979723:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330343.979853:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee74ff0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330343.984940:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792444800 00000100:00100000:2.0:1788330343.984966:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792444800 00000100:00100000:2.0:1788330343.985059:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788330343.985073:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17101:x1875199792444800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330343.985318:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:17101:x1875199792444800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 248us (5593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330343.985328:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788330343.985690:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792444800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788330343.987527:0:18320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788330343.987638:0:17101:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788330343.992274:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788330343.992304:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eeef91ac00/0x8475908e9fd21e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd21eb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330343.992320:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eeef91ac00/0x8475908e9fd21e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd21eb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330344.036827:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330345.051283:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330346.081014:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788330346.397895:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330346.397914:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788330346.397917:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330346.397930:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788330346.397952:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330346.397955:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788330346.397957:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330346.397960:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788330346.397999:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792445056:0@lo:400:kworker.0 00000100:00100000:2.0:1788330346.398105:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330346.398186:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330346.398196:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792445184:0@lo:400:kworker.0 00000100:00100000:2.0:1788330346.398226:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330346.398268:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792445056 00000100:00100000:2.0:1788330346.398277:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792445056 00000100:00100000:2.0:1788330346.398466:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788330346.398479:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792445056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330346.398544:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792445056:12345-0@lo:400:kworker.0 Request processed in 69us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330346.398551:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788330346.398577:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792445184 00000100:00100000:2.0:1788330346.398581:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792445184 00000100:00100000:2.0:1788330346.398611:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788330346.398618:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792445184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330346.398649:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792445184:12345-0@lo:400:kworker.0 Request processed in 32us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330346.398655:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788330346.398701:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99edc5ee9180 x1875199792445184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330346.398725:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792445184:0@lo:400:kworker.0 00000100:00100000:2.0:1788330346.398739:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792445056:0@lo:400:kworker.0 00000100:00100000:1.0:1788330346.404418:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792445312:0@lo:400:kworker.0 00000100:00100000:1.0:1788330346.404532:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330346.404585:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788330346.404592:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792444928:0@lo:400:kworker.0 00000100:00100000:1.0:1788330346.404626:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330346.404663:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792445440:0@lo:400:kworker.0 00000100:00100000:1.0:1788330346.404689:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330346.404746:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792444928 00000100:00100000:1.0:1788330346.404757:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792444928 00000100:00100000:1.0:1788330346.404813:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788330346.404824:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:3648:x1875199792444928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330346.404887:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:3648:x1875199792444928:12345-0@lo:400:kworker.0 Request processed in 65us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330346.404896:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788330346.404948:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792445440 00000100:00100000:1.0:1788330346.404952:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792445440 00000100:00100000:1.0:1788330346.404980:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788330346.404987:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792445440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330346.405023:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792445440:12345-0@lo:400:kworker.0 Request processed in 36us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330346.405030:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788330346.405079:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792444928:0@lo:400:kworker.0 00010000:00080000:1.0:1788330346.405095:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99edc5ee9f80 x1875199792445440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330346.405108:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792445440:0@lo:400:kworker.0 00000100:00100000:2.0:1788330346.405666:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792445312 00000100:00100000:2.0:1788330346.405672:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792445312 00000100:00100000:2.0:1788330346.405706:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788330346.405714:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792445312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330346.405764:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792445312:12345-0@lo:400:kworker.0 Request processed in 52us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330346.405771:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788330346.405805:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792445312:0@lo:400:kworker.0 00010000:00010000:3.0:1788330347.099528:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330347.419673:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788330347.419717:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792445568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330347.420692:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330347.420925:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792445568 00000100:00100000:0.0:1788330347.420937:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792445568 00000100:00100000:0.0:1788330347.421004:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788330347.421018:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792445568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788330347.421132:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788330347.421215:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792445568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 200us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330347.421224:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788330347.421423:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792445568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330347.422547:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330347.425213:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792445696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330347.425308:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330347.425466:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792445696 00000100:00100000:0.0:1788330347.425486:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792445696 00000100:00100000:0.0:1788330347.425552:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788330347.425564:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792445696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330347.425612:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788330347.425680:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792445696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330347.425688:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788330347.428965:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792445696:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788330347.549854:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788330348.123630:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330349.164509:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330350.171594:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330351.195455:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788330351.517298:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330351.517306:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788330351.517309:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330351.517312:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788330351.517350:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330351.517354:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788330351.517357:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330351.517367:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788330351.517409:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792445824:0@lo:400:kworker.0 00000100:00100000:3.0:1788330351.517512:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330351.517566:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792446336:0@lo:400:kworker.0 00000100:00100000:3.0:1788330351.517600:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330351.517630:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330351.517636:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792445952:0@lo:400:kworker.0 00000100:00100000:3.0:1788330351.517664:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330351.517698:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792446208:0@lo:400:kworker.0 00000100:00100000:3.0:1788330351.517726:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330351.517745:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788330351.517750:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792446080:0@lo:400:kworker.0 00000100:00100000:3.0:1788330351.517774:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330351.517820:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792445824 00000100:00100000:3.0:1788330351.517830:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792445824 00000100:00100000:3.0:1788330351.517896:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788330351.518024:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:3648:x1875199792445824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330351.518084:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:3648:x1875199792445824:12345-0@lo:400:kworker.0 Request processed in 64us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330351.518092:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788330351.518130:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792446336 00000100:00100000:3.0:1788330351.518134:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792446336 00000100:00100000:3.0:1788330351.518180:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792446080 00000100:00100000:3.0:1788330351.518184:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792446080 00000100:00100000:3.0:1788330351.518201:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788330351.518207:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792446336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330351.518255:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792446336:12345-0@lo:400:kworker.0 Request processed in 49us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330351.518282:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788330351.518295:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788330351.518301:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792446080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330351.518331:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792446080:12345-0@lo:400:kworker.0 Request processed in 31us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330351.518336:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788330351.518356:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792445952 00000100:00100000:3.0:1788330351.518361:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792445952 00000100:00100000:3.0:1788330351.518378:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792446208 00000100:00100000:3.0:1788330351.518381:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792446208 00000100:00100000:3.0:1788330351.518395:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788330351.518401:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792445952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330351.518434:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792445952:12345-0@lo:400:kworker.0 Request processed in 33us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330351.518440:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788330351.518452:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788330351.518457:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792446208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330351.518483:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792446208:12345-0@lo:400:kworker.0 Request processed in 27us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330351.518489:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788330351.518544:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99edc75fdf80 x1875199792446080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330351.518561:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792446080:0@lo:400:kworker.0 00000100:00100000:3.0:1788330351.518585:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792446208:0@lo:400:kworker.0 00000100:00100000:3.0:1788330351.518623:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792445952:0@lo:400:kworker.0 00000100:00100000:3.0:1788330351.518631:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792445824:0@lo:400:kworker.0 00010000:00080000:3.0:1788330351.518640:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99edc75fdc00 x1875199792446336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330351.518648:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792446336:0@lo:400:kworker.0 00000020:01000004:2.0:1788330352.056127:0:18605:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788330352.056133:0:18605:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788330352.056135:0:18605:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788330352.056295:0:18605:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99eec91d5800 00000020:01000004:2.0:1788330352.056318:0:18605:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788330352.056334:0:18605:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788330352.056353:0:18605:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99eec8bb4d28) 00000020:00000080:2.0:1788330352.056375:0:18605:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788330352.141439:0:18605:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788330352.143508:0:18605:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788330352.144283:0:18605:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788330352.144513:0:18605:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788330352.145007:0:18605:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788330352.145238:0:18605:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788330352.145454:0:18605:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1788330352.148541:0:18605:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788330352.149083:0:18605:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788330352.149101:0:18605:0:(osd_handler.c:8927:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788330352.149117:0:18605:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8475908e9fd21f9 00000020:01000004:2.0:1788330352.149126:0:18605:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788330352.149325:0:18605:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.150@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788330352.149330:0:18605:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788330352.149338:0:18605:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788330352.149428:0:18605:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788330352.149447:0:18605:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99eee75719b8) 00000020:00000080:3.0:1788330352.149463:0:18605:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788330352.151066:0:18605:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788330352.151311:0:18605:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788330352.151319:0:18605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788330352.163030:0:18605:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788330352.163050:0:18605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788330352.178097:0:18605:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788330352.178123:0:18605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788330352.183335:0:18605:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788330352.183758:0:18605:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788330352.183768:0:18605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788330352.185082:0:18605:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788330352.185095:0:18605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:2.0:1788330352.219388:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330352.245797:0:18605:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788330352.246449:0:18605:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788330352.246460:0:18605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788330352.251717:0:18605:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788330352.251736:0:18605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788330352.252715:0:18605:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788330352.252725:0:18605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788330352.262971:0:18605:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788330352.263333:0:18605:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788330352.263341:0:18605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788330352.267880:0:18605:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788330352.267902:0:18605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788330352.372289:0:18605:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788330352.372530:0:18605:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788330352.372538:0:18605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788330352.374106:0:18605:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788330352.374120:0:18605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788330352.377676:0:18605:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788330352.377824:0:18605:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788330352.377834:0:18605:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788330352.396957:0:18605:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788330352.397077:0:18605:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.150@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788330352.397083:0:18605:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788330352.397085:0:18605:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788330352.397086:0:18605:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330352.397088:0:18605:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330352.397090:0:18605:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330352.397091:0:18605:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330352.397093:0:18605:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788330352.397095:0:18605:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330352.397097:0:18605:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788330352.397101:0:18605:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788330352.397104:0:18605:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788330352.397105:0:18605:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788330352.397106:0:18605:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330352.397107:0:18605:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330352.397108:0:18605:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330352.397109:0:18605:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330352.397110:0:18605:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788330352.397111:0:18605:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330352.397112:0:18605:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788330352.397524:0:18605:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788330352.397555:0:18605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7643100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792446464:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788330352.397669:0:18605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330352.397729:0:18605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59cde40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330352.400543:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792446464 00000100:00100000:2.0:1788330352.400563:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792446464 00000100:00100000:2.0:1788330352.400648:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788330352.400662:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:18605:x1875199792446464:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788330352.400712:0:17097:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788330352.400716:0:17097:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788330352.400721:0:17097:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788330352.401569:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:18605:x1875199792446464:12345-0@lo:253:mount.lustre.0 Request processed in 908us (3898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330352.401579:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788330352.404099:0:18605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7643100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792446464:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788330352.404127:0:18605:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788330352.404131:0:18605:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788330352.404134:0:18605:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788330352.404135:0:18605:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330352.404136:0:18605:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330352.404138:0:18605:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330352.404139:0:18605:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330352.404141:0:18605:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788330352.404143:0:18605:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330352.404712:0:18605:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788330352.404765:0:18605:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99eec91d5800 from lustre-OST0000 10000000:01000000:3.0:1788330352.404809:0:18605:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788330352.404813:0:18605:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788330352.404826:0:18605:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99edc67d8000 local copy 00010000:00010000:3.0:1788330352.404842:0:18605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd1fb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1fbb expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330352.405130:0:18605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7643100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792446592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330352.405490:0:18605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330352.405610:0:18605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59cd780 going to sleep for 11 seconds 00000100:00100000:1.0:1788330352.405696:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792446592 00000100:00100000:1.0:1788330352.405704:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792446592 00000100:00100000:1.0:1788330352.405764:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788330352.405776:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:18605:x1875199792446592:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330352.405942:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:18605:x1875199792446592:12345-0@lo:501:mount.lustre.0 Request processed in 167us (451us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788330352.405950:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788330352.406503:0:18605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7643100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792446592:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788330352.406527:0:18605:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788330352.406557:0:18605:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788330352.406566:0:18605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd1fb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1fbb expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330352.406577:0:18605:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd1fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1fbb expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330352.406611:0:18605:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99eec91d5800 10000000:01000000:0.0:1788330352.406627:0:18605:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788330352.406634:0:18605:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788330352.406637:0:18605:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788330352.406642:0:18605:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788330352.406646:0:18605:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788330352.406681:0:18605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1326200/0x8475908e9fd2207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330352.406689:0:18605:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec1326200/0x8475908e9fd2207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330352.406700:0:18605:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec1326200/0x8475908e9fd2207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330352.406719:0:18605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792446720:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788330352.406760:0:18605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330352.410116:0:18605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec920cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330352.411052:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792446720 00000100:00100000:2.0:1788330352.411065:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792446720 00000100:00100000:2.0:1788330352.411142:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788330352.411243:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+18:18605:x1875199792446720:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788330352.411412:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330352.411454:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec9038600/0x8475908e9fd220e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2207 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.411490:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9038600/0x8475908e9fd220e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2207 expref: 19 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.411503:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec9038600/0x8475908e9fd220e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2207 expref: 19 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.411514:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038600, rc 0) 00000100:00100000:2.0:1788330352.412055:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+19:18605:x1875199792446720:12345-0@lo:101:mount.lustre.0 Request processed in 900us (5291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330352.412064:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788330352.412191:0:18605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792446720:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330352.412217:0:18605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec1326200/0x8475908e9fd2207 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd220e expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330352.412229:0:18605:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec1326200/0x8475908e9fd2207 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd220e expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788330352.416602:0:18605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788330352.417436:0:18605:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788330352.419505:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788330352.419570:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788330352.419584:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788330352.419598:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788330352.419623:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788330352.419637:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788330352.419663:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788330352.419668:0:18605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788330352.419808:0:18605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792446848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330352.420369:0:18605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330352.420483:0:18605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec920cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788330352.420532:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792446848 00000100:00100000:3.0:1788330352.420542:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792446848 00000100:00100000:3.0:1788330352.420644:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788330352.420657:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+19:18605:x1875199792446848:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330352.420864:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+19:18605:x1875199792446848:12345-0@lo:501:mount.lustre.0 Request processed in 209us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330352.420874:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788330352.420962:0:18605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792446848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330352.421022:0:18605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792446976:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330352.421071:0:18605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330352.421399:0:18605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec920cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788330352.421480:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792446976 00000100:00100000:1.0:1788330352.421486:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792446976 00000100:00100000:1.0:1788330352.421516:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788330352.421523:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+19:18605:x1875199792446976:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330352.422538:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+19:18605:x1875199792446976:12345-0@lo:503:mount.lustre.0 Request processed in 1010us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330352.422549:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788330352.422690:0:18605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792446976:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788330352.423649:0:18605:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788330352.423750:0:18605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7643b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792447104:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330352.423811:0:18605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330352.423954:0:18605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef59cd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788330352.424080:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792447104 00000100:00100000:0.0:1788330352.424088:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792447104 00000100:00100000:0.0:1788330352.424256:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788330352.424267:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+19:18605:x1875199792447104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330352.424670:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+19:18605:x1875199792447104:12345-0@lo:502:mount.lustre.0 Request processed in 405us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330352.424676:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788330352.424745:0:18605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7643b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792447104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788330352.425013:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788330352.425037:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788330352.425045:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788330352.425065:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788330352.425074:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788330352.425081:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788330352.425093:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788330352.425106:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788330352.425122:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788330352.425134:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788330352.425187:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788330352.425206:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788330352.425231:0:18605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792447232:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788330352.425272:0:18605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330352.425702:0:18605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee76e7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330352.425784:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792447232 00000100:00100000:3.0:1788330352.425791:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792447232 00000100:00100000:3.0:1788330352.425826:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788330352.425835:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+19:18605:x1875199792447232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330352.426053:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+19:18605:x1875199792447232:12345-0@lo:502:mount.lustre.0 Request processed in 218us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330352.426068:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788330352.426293:0:18605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792447232:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788330352.426358:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788330352.426370:0:18605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788330352.427725:0:18623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788330352.427738:0:18623:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788330352.427746:0:18623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330352.427749:0:18623:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788330352.427756:0:18623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788330352.427776:0:18623:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99eee7574d28) 00000020:00000080:3.0:1788330352.427815:0:18623:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788330352.427824:0:18623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788330352.428118:0:18623:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99eec91d5800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788330352.428129:0:18623:0:(osd_handler.c:8927:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788330352.428139:0:18623:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8475908e9fd221c 00010000:00010000:3.0:1788330352.437122:0:18623:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788330352.437829:0:18623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1788330352.440067:0:18623:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788330352.441640:0:18623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788330352.441657:0:18623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788330352.441665:0:18623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330352.441667:0:18623:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788330352.441672:0:18623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788330352.441676:0:18623:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1788330352.441677:0:18623:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788330352.441688:0:18623:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788330352.441690:0:18623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788330352.441693:0:18623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330352.441694:0:18623:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788330352.441697:0:18623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788330352.441700:0:18623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330352.441701:0:18623:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788330352.441704:0:18623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788330352.441707:0:18623:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788330352.441709:0:18623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788330352.441712:0:18623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330352.441713:0:18623:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788330352.441716:0:18623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788330352.441718:0:18623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330352.441719:0:18623:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788330352.441723:0:18623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788330352.441759:0:18623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788330352.441762:0:18623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330352.441763:0:18623:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788330352.441767:0:18623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788330352.442067:0:18605:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788330352.442106:0:18605:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788330352.442135:0:18605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1326200/0x8475908e9fd2207 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd220e expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330352.442237:0:18605:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec1326200/0x8475908e9fd2207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd220e expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330352.442249:0:18605:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eec91d5800 from 1 10000000:01000000:3.0:1788330352.442252:0:18605:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788330352.442300:0:18605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eeef91aa00/0x8475908e9fd2223 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330352.442309:0:18605:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eeef91aa00/0x8475908e9fd2223 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330352.442347:0:18605:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eeef91aa00/0x8475908e9fd2223 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330352.442379:0:18605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792447360:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788330352.442468:0:18605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330352.442517:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792447360 00000100:00100000:3.0:1788330352.442526:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792447360 00000100:00100000:3.0:1788330352.442573:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788330352.442583:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+19:18605:x1875199792447360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330352.442601:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330352.442616:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eeef91b800/0x8475908e9fd222a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2223 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330352.442657:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eeef91b800/0x8475908e9fd222a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2223 expref: 20 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330352.442672:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eeef91b800/0x8475908e9fd222a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2223 expref: 20 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330352.442683:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eeef91b800, rc 0) 00000100:00100000:3.0:1788330352.442721:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+20:18605:x1875199792447360:12345-0@lo:101:mount.lustre.0 Request processed in 139us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330352.442729:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788330352.442776:0:18605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc7d7e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330352.442801:0:18605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792447360:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330352.442815:0:18605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eeef91aa00/0x8475908e9fd2223 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd222a expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330352.442832:0:18605:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eeef91aa00/0x8475908e9fd2223 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd222a expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788330352.448785:0:18605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788330352.450258:0:18605:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788330352.450489:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788330352.450517:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788330352.450534:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788330352.450539:0:18605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788330352.450628:0:18605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792447488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330352.450711:0:18605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330352.451545:0:18605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc7d7e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788330352.452457:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792447488 00000100:00100000:2.0:1788330352.452470:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792447488 00000100:00100000:2.0:1788330352.452576:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788330352.452598:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+20:18605:x1875199792447488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330352.453440:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+20:18605:x1875199792447488:12345-0@lo:501:mount.lustre.0 Request processed in 851us (2725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330352.453451:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788330352.453580:0:18605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792447488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330352.453644:0:18605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792447616:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788330352.453704:0:18605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330352.454972:0:18605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee76e7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330352.454982:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792447616 00000100:00100000:3.0:1788330352.455049:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792447616 00000100:00100000:3.0:1788330352.455405:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788330352.455418:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+20:18605:x1875199792447616:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788330352.455716:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+20:18605:x1875199792447616:12345-0@lo:503:mount.lustre.0 Request processed in 300us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330352.455725:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788330352.456504:0:18605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792447616:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788330352.457264:0:18605:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788330352.457384:0:18605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792447744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788330352.457458:0:18605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330352.457496:0:18605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee76e7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330352.458866:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792447744 00000100:00100000:3.0:1788330352.458880:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792447744 00000100:00100000:3.0:1788330352.459037:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788330352.459048:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+20:18605:x1875199792447744:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330352.459240:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+20:18605:x1875199792447744:12345-0@lo:502:mount.lustre.0 Request processed in 193us (1782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330352.459654:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788330352.460626:0:18605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792447744:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788330352.460970:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788330352.461006:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788330352.461021:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788330352.461033:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788330352.461046:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788330352.461057:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788330352.461071:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788330352.461083:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788330352.461108:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788330352.461121:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788330352.461135:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788330352.461330:0:18605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7696300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792447872:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330352.461411:0:18605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330352.464853:0:18605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788330352.465006:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792447872 00000100:00100000:1.0:1788330352.465020:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792447872 00000100:00100000:1.0:1788330352.465431:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788330352.465443:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+20:18605:x1875199792447872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788330352.465659:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+20:18605:x1875199792447872:12345-0@lo:502:mount.lustre.0 Request processed in 217us (4247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330352.465667:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788330352.465788:0:18605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7696300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792447872:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788330352.465974:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788330352.465994:0:18605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788330352.466969:0:18627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788330352.466983:0:18627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330352.466987:0:18627:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788330352.466995:0:18627:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99eec91d5800 00000020:00000080:0.0:1788330352.466998:0:18627:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788330352.467009:0:18627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788330352.467011:0:18627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330352.467012:0:18627:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788330352.467015:0:18627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788330352.467017:0:18627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330352.467018:0:18627:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788330352.467022:0:18627:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99eec91d5800 00000020:00000080:0.0:1788330352.467024:0:18627:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788330352.467302:0:18627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788330352.467306:0:18627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330352.467315:0:18627:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788330352.467318:0:18627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788330352.467321:0:18627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330352.467323:0:18627:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788330352.467327:0:18627:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99eec91d5800 00000020:00000080:0.0:1788330352.467329:0:18627:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788330352.469436:0:18627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788330352.469454:0:18627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330352.469456:0:18627:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788330352.469461:0:18627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788330352.469465:0:18627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330352.469467:0:18627:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788330352.469472:0:18627:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99eec91d5800 00000020:00000080:0.0:1788330352.469475:0:18627:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788330352.469539:0:18627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788330352.469542:0:18627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330352.469544:0:18627:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788330352.469547:0:18627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788330352.470354:0:18605:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788330352.470394:0:18605:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788330352.470419:0:18605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eeef91aa00/0x8475908e9fd2223 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd222a expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.470433:0:18605:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eeef91aa00/0x8475908e9fd2223 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd222a expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330352.470514:0:18605:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788330352.470517:0:18605:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99eec91d5800 10000000:01000000:2.0:1788330352.470521:0:18605:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99eec91d5800 10000000:01000000:2.0:1788330352.470526:0:18605:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788330352.470533:0:18605:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99eec91d5800 from 1 10000000:01000000:2.0:1788330352.470536:0:18605:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788330352.470582:0:18605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.470592:0:18605:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.470605:0:18605:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330352.470643:0:18605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7696300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792448000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788330352.470727:0:18605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330352.470833:0:18605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788330352.472341:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792448000 00000100:00100000:1.0:1788330352.472357:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792448000 00000100:00100000:1.0:1788330352.472438:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788330352.472450:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+20:18605:x1875199792448000:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330352.472470:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330352.472489:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eefe7ee000/0x8475908e9fd2238 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2231 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330352.472522:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eefe7ee000/0x8475908e9fd2238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2231 expref: 21 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330352.472534:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eefe7ee000/0x8475908e9fd2238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2231 expref: 21 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330352.472546:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eefe7ee000, rc 0) 00000100:00100000:1.0:1788330352.472622:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:18605:x1875199792448000:12345-0@lo:101:mount.lustre.0 Request processed in 174us (1895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330352.472630:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788330352.473327:0:18605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7696300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792448000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788330352.473350:0:18605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2231 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2238 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.473361:0:18605:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2231 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2238 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788330352.474626:0:18605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788330352.475068:0:18605:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788330352.476549:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788330352.476600:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788330352.476616:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788330352.476631:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788330352.476645:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788330352.476660:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788330352.476672:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788330352.476685:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788330352.476698:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788330352.476711:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788330352.476725:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788330352.476756:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788330352.476773:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788330352.476787:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788330352.476800:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788330352.476814:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788330352.476825:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788330352.476861:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788330352.476876:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788330352.476888:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788330352.476900:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788330352.476913:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788330352.476926:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788330352.476939:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788330352.476952:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788330352.476964:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788330352.476978:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788330352.477006:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788330352.477020:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788330352.477032:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788330352.477045:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788330352.477056:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788330352.477067:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788330352.477078:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788330352.477089:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788330352.477102:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788330352.477115:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788330352.477139:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788330352.482267:0:18605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788330352.482424:0:18605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7696300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792448128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330352.483373:0:18605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330352.483479:0:18605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330352.490057:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792448128 00000100:00100000:1.0:1788330352.490081:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792448128 00000100:00100000:1.0:1788330352.490379:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788330352.490397:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:18605:x1875199792448128:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330352.491261:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:18605:x1875199792448128:12345-0@lo:501:mount.lustre.0 Request processed in 864us (7887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330352.491272:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788330352.491319:0:18605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7696300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792448128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330352.491397:0:18605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7643800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792448256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788330352.491452:0:18605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330352.491511:0:18605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc719a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788330352.491629:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792448256 00000100:00100000:2.0:1788330352.491636:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792448256 00000100:00100000:2.0:1788330352.491681:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788330352.491691:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec908c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:18605:x1875199792448256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788330352.491883:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec908c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:18605:x1875199792448256:12345-0@lo:503:mount.lustre.0 Request processed in 193us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330352.491899:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788330352.497107:0:18605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7643800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792448256:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788330352.498111:0:18605:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788330352.498473:0:18605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7643800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792448384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330352.498797:0:18605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330352.498899:0:18605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc719a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788330352.502794:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792448384 00000100:00100000:2.0:1788330352.502817:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792448384 00000100:00100000:2.0:1788330352.504606:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788330352.504632:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec908d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:18605:x1875199792448384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330352.505675:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec908d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:18605:x1875199792448384:12345-0@lo:502:mount.lustre.0 Request processed in 1047us (6872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330352.505689:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788330352.507677:0:18605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7643800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792448384:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788330352.508221:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788330352.508258:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788330352.508274:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788330352.508290:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788330352.508306:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788330352.508326:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788330352.508344:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788330352.508361:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788330352.508375:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788330352.508394:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788330352.508413:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788330352.508435:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788330352.508455:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788330352.508475:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788330352.508508:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788330352.508537:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788330352.508555:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788330352.508575:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788330352.508593:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788330352.508612:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788330352.508630:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788330352.508648:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788330352.508667:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788330352.508686:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788330352.508719:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788330352.508738:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788330352.508757:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788330352.508774:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788330352.508793:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788330352.508812:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788330352.508830:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788330352.508861:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788330352.508878:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788330352.508893:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788330352.508907:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788330352.508921:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788330352.508935:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788330352.508947:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788330352.508960:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788330352.508973:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788330352.508997:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788330352.509011:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788330352.509024:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788330352.509036:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788330352.509049:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788330352.509061:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788330352.509077:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788330352.509094:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788330352.509227:0:18605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792448512:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330352.509328:0:18605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330352.509382:0:18605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec920c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788330352.510646:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792448512 00000100:00100000:2.0:1788330352.510657:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792448512 00000100:00100000:2.0:1788330352.510713:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788330352.510722:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:18605:x1875199792448512:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330352.511705:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:18605:x1875199792448512:12345-0@lo:502:mount.lustre.0 Request processed in 980us (2375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330352.511716:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788330352.512942:0:18605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792448512:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788330352.513299:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788330352.513333:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788330352.513380:0:18605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792448640:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330352.513452:0:18605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330352.514712:0:18605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec920c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788330352.514803:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792448640 00000100:00100000:2.0:1788330352.514812:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792448640 00000100:00100000:2.0:1788330352.514881:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788330352.514893:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:18605:x1875199792448640:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330352.515064:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:18605:x1875199792448640:12345-0@lo:502:mount.lustre.0 Request processed in 173us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330352.515073:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788330352.515298:0:18605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792448640:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788330352.515381:0:18605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788330352.515396:0:18605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788330352.533344:0:18632:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788330352.533366:0:18632:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99eee764cd28) 00000020:00000080:3.0:1788330352.533397:0:18632:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788330352.533510:0:18632:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99eec91d5800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788330352.533515:0:18632:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99eec91d5800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788330352.533517:0:18632:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eec91d5800 3 00010000:00080000:3.0:1788330352.533550:0:18632:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc6580800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.150@tcp at head 00010000:00010000:3.0:1788330352.535418:0:18632:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788330352.535956:0:18632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788330352.536009:0:18632:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788330352.536026:0:18632:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8475908e9fd2246 00000100:00080000:3.0:1788330352.536041:0:18632:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788330352.536049:0:18632:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99edc6580800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330352.536095:0:18632:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eee7643800 x1875199792448768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788330352.536130:0:18632:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788330352.539331:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875199792448768:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1788330352.539395:0:18632:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788330352.539415:0:18632:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff99eee76499b8) 00000020:00000080:3.0:1788330352.539440:0:18632:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000100:00100000:1.0:1788330352.539449:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1788330352.539546:0:18632:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99eec91d5800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788330352.539550:0:18632:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99eec91d5800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788330352.539553:0:18632:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99eec91d5800 3 00010000:00080000:3.0:1788330352.539589:0:18632:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc7f1e000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.150@tcp at head 00000100:00100000:0.0:1788330352.539623:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792448896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330352.539667:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788330352.539697:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330352.539702:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788330352.539712:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330352.539715:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788330352.539716:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792448896 00000100:00100000:0.0:1788330352.539724:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792448896 00000100:00080000:1.0:1788330352.539728:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330352.539730:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788330352.539733:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330352.539735:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788330352.539772:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788330352.539781:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792449024:0@lo:400:kworker.0 00000100:00100000:0.0:1788330352.539782:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792448896:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330352.539811:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1788330352.539824:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788330352.539825:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330352.539830:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792449152:0@lo:400:kworker.0 00000100:00100000:1.0:1788330352.539865:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330352.539899:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792449280:0@lo:400:kworker.0 00000100:00100000:1.0:1788330352.539925:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330352.539943:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788330352.539948:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792449408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330352.539971:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330352.540001:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792448768 00000100:00100000:1.0:1788330352.540005:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792448768 00000100:00100000:1.0:1788330352.540021:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792449152 00000100:00100000:1.0:1788330352.540023:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792449152 00000100:00100000:1.0:1788330352.540041:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792449280 00000100:00100000:1.0:1788330352.540043:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792449280 00000100:00100000:1.0:1788330352.540055:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788330352.540061:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792449152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330352.540077:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792448896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 295us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330352.540085:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788330352.540094:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792449152:12345-0@lo:400:kworker.0 Request processed in 34us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330352.540105:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792449024 00000100:00100000:1.0:1788330352.540106:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788330352.540108:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792449024 00000100:00100000:0.0:1788330352.540121:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792449408 00000100:00100000:0.0:1788330352.540124:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792449408 00000100:00100000:1.0:1788330352.540134:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788330352.540134:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788330352.540139:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792449280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330352.540146:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792449024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330352.540340:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875199792449024:12345-0@lo:400:kworker.0 Request processed in 193us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330352.540346:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788330352.540363:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788330352.540370:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792449408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330352.540389:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788330352.540423:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792449408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330352.540428:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788330352.540921:0:17105:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788330352.540932:0:17105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788330352.541048:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788330352.541055:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875199792448768:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788330352.541085:0:17105:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:2.0:1788330352.541122:0:17105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8475908e9fd2254 00000004:00100000:2.0:1788330352.541141:0:17105:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788330352.541406:0:17105:0:(import.c:65:import_set_state_nolock()) ffff99eededf0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330352.541485:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875199792448768:12345-0@lo:38:llog_process_th.0 Request processed in 429us (2037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330352.541493:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788330352.542046:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99eee7643800 x1875199792448768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788330362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330352.542060:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788330352.542070:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788330352.542079:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788330352.542084:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788330352.542087:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc6580800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788330352.542094:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875199792448768:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788330352.542452:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792448896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330352.542593:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792449280:12345-0@lo:400:kworker.0 Request processed in 2104us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330352.542604:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788330352.542649:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99edc7e75180 x1875199792449152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330352.542659:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792449152:0@lo:400:kworker.0 00000100:00100000:1.0:1788330352.542672:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792449024:0@lo:400:kworker.0 00000100:00100000:1.0:1788330352.542705:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792449408:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1788330352.542716:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99edc7e74380 x1875199792449280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330352.542726:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792449280:0@lo:400:kworker.0 00010000:00010000:3.0:1788330352.543308:0:18632:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788330352.544021:0:18632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788330352.544079:0:18632:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788330352.544092:0:18632:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x8475908e9fd225b 00000100:00080000:3.0:1788330352.544102:0:18632:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788330352.544108:0:18632:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff99edc7f1e000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330352.544143:0:18632:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eee7641880 x1875199792449536/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788330352.544180:0:18632:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788330352.544406:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875199792449536:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788330352.544492:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330352.544574:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792449536 00000100:00100000:3.0:1788330352.544581:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792449536 00000100:00100000:3.0:1788330352.544612:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788330352.544619:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875199792449536:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788330352.544643:0:17105:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:3.0:1788330352.544697:0:17105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x8475908e9fd2262 00000004:00100000:3.0:1788330352.544716:0:17105:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788330352.544760:0:17105:0:(import.c:65:import_set_state_nolock()) ffff99edc7f1e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788330352.545053:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875199792449536:12345-0@lo:38:llog_process_th.0 Request processed in 429us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330352.545060:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788330352.545480:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330352.545487:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788330352.545491:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330352.545493:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788330352.545498:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330352.545501:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788330352.545503:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330352.545514:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1788330352.545719:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99eee7641880 x1875199792449536/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788330362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330352.545731:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788330352.545747:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788330352.545757:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788330352.545763:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788330352.545767:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7f1e000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788330352.545776:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875199792449536:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788330352.545878:0:18632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788330352.545960:0:18605:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788330352.545998:0:18605:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788330352.546137:0:18605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2238 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330352.546185:0:18605:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec9038c00/0x8475908e9fd2231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2238 expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788330352.546243:0:18605:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788330352.546246:0:18605:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788330352.546257:0:18605:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330352.546258:0:18605:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330352.546260:0:18605:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330352.546261:0:18605:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330352.546263:0:18605:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788330352.546265:0:18605:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330352.546266:0:18605:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788330352.546271:0:18605:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788330352.546274:0:18605:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788330352.546275:0:18605:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788330352.546276:0:18605:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330352.546277:0:18605:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330352.546278:0:18605:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330352.546279:0:18605:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330352.546280:0:18605:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788330352.546281:0:18605:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330352.546282:0:18605:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788330352.546306:0:18605:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788330352.546325:0:18605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792449664:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788330352.546392:0:18605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330352.546643:0:18605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee733e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788330352.547031:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792449664 00000100:00100000:0.0:1788330352.547042:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792449664 00000100:00100000:0.0:1788330352.547108:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788330352.547119:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:18605:x1875199792449664:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788330352.547178:0:17098:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788330352.547198:0:17098:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788330352.561298:0:17098:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788330352.561517:0:17098:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788330352.561628:0:17119:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788330352.561635:0:17119:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788330352.561665:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2269 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330352.561688:0:17119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eec9039400/0x8475908e9fd21b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd21ac expref: 21 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330352.561697:0:17119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eec9038800/0x8475908e9fd21c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd21ba expref: 21 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330352.561705:0:17119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2269 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330352.561752:0:17119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eec9038800/0x8475908e9fd21c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd21ba expref: 21 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330352.561768:0:17119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eec9038800/0x8475908e9fd21c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd21ba expref: 21 pid: 17098 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330352.561785:0:17119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7641180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1875199792449792:0@lo:104: 00000100:00100000:3.0:1788330352.562099:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330352.562287:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:18605:x1875199792449664:12345-0@lo:253:mount.lustre.0 Request processed in 15166us (15891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330352.562301:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:3.0:1788330352.562393:0:17119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eec9039400/0x8475908e9fd21b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd21ac expref: 20 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330352.562404:0:17119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eec9039400/0x8475908e9fd21b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd21ac expref: 20 pid: 17098 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330352.562414:0:17119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7641f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1875199792449920:0@lo:104: 00000100:00100000:3.0:1788330352.562442:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330352.563839:0:18605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:18605:1875199792449664:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788330352.564067:0:18605:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788330352.564072:0:18605:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788330352.564074:0:18605:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788330352.564076:0:18605:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330352.564078:0:18605:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330352.564079:0:18605:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330352.564081:0:18605:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330352.564082:0:18605:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788330352.564090:0:18605:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330352.564092:0:18605:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788330352.564117:0:18605:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788330352.564616:0:17086:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788330352.564637:0:17119:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc719a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330352.564645:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792449792 00000100:00100000:2.0:1788330352.564654:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792449792 00000100:00100000:2.0:1788330352.564702:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792449920 00000100:00100000:2.0:1788330352.564705:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792449920 00000100:00100000:2.0:1788330352.564722:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788330352.564732:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+4:17119:x1875199792449792:12345-0@lo:104: 00010000:00010000:2.0:1788330352.564751:0:17086:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd21ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd21c1 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.564838:0:17086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788330352.564855:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+4:17119:x1875199792449792:12345-0@lo:104: Request processed in 114us (2747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330352.564863:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788330352.564942:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788330352.565055:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330352.565062:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd21ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd21c1 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.565085:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147ba00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:2.0:1788330352.565090:0:17091:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd21ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd21c1 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.565101:0:17091:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd21ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd21c1 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330352.565109:0:17091:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd21ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd21c1 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330352.565110:0:17119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7641180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1875199792449792:0@lo:104: 10000000:01000000:2.0:1788330352.565123:0:17091:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788330352.565192:0:17091:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd21ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd21c1 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.565199:0:17091:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788330352.565232:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd21ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd21c1 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.565239:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec147ba00/0x8475908e9fd21ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd21c1 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.565255:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330352.565257:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330352.565259:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330352.565305:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792450048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330352.565318:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefea76850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+3:17119:x1875199792449920:12345-0@lo:104: 00010000:00010000:0.0:1788330352.565329:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd21ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd21b3 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330352.565344:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330352.565396:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1788330352.565402:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788330352.565405:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefea76850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+3:17119:x1875199792449920:12345-0@lo:104: Request processed in 94us (2961us total) trans 0 rc 0/0 00010000:00010000:3.0:1788330352.565407:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd21ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd21b3 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330352.565419:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147b800 already unused, calling callback (ffffffffc14efc20) 00000100:00100000:0.0:1788330352.565422:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 10000000:00010000:3.0:1788330352.565423:0:17092:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd21ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd21b3 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330352.565432:0:17092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd21ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd21b3 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330352.565437:0:17092:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd21ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd21b3 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330352.565440:0:17092:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788330352.565459:0:17092:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd21ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd21b3 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330352.565463:0:17092:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330352.565472:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd21ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd21b3 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330352.565475:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec147b800/0x8475908e9fd21ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd21b3 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330352.565491:0:17119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7641f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1875199792449920:0@lo:104: 00010000:00010000:0.0:1788330352.565514:0:17119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2269 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330352.565541:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330352.565550:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330352.565552:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330352.565567:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330352.565577:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792450176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330352.565580:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792450048 00000100:00100000:2.0:1788330352.565587:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792450048 00010000:00010000:2.0:1788330352.565611:0:17088:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eec9038800/0x8475908e9fd21c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd21ba expref: 21 pid: 17098 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330352.565613:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330352.566086:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792450176 00000100:00100000:2.0:1788330352.566096:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792450176 00010000:00010000:2.0:1788330352.566110:0:17088:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eec9039400/0x8475908e9fd21b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd21ac expref: 22 pid: 17098 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330352.566126:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788330352.566132:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7642300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:3646:x1875199792450048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330352.566143:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330352.566148:0:17088:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eec9038800/0x8475908e9fd21c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd21ba expref: 22 pid: 17098 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.566184:0:17088:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eec9038800/0x8475908e9fd21c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd21ba expref: 22 pid: 17098 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.566201:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec9038800/0x8475908e9fd21c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd21ba expref: 22 pid: 17098 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.566219:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330352.566256:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7642300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:3646:x1875199792450048:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330352.566263:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788330352.566279:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788330352.566285:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed06a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+20:3646:x1875199792450176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330352.566292:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330352.566297:0:17088:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eec9039400/0x8475908e9fd21b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd21ac expref: 20 pid: 17098 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.566306:0:17088:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eec9039400/0x8475908e9fd21b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd21ac expref: 20 pid: 17098 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.566317:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec9039400/0x8475908e9fd21b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd21ac expref: 20 pid: 17098 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330352.566335:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792450048:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330352.566339:0:17088:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2269 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.566351:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2269 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788330352.566367:0:17088:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014354416s 00010000:00010000:2.0:1788330352.566372:0:17088:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2269 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.566380:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2269 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.566388:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2269 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.566395:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2269 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.566400:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91be00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330352.566404:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2269 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.566412:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2269 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.566431:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2269 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330352.566441:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330352.566451:0:17119:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2269 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330352.566461:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2269 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330352.566467:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2269 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330352.566482:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed06a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+19:3646:x1875199792450176:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330352.566490:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788330352.566542:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792450176:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1788330352.570228:0:18605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788330352.574440:0:18605:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788330352.574453:0:18605:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788330352.574508:0:18605:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788330352.574572:0:18605:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.150@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788330352.574596:0:18605:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788330352.574620:0:18605:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788330352.576184:0:18605:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788330352.576734:0:18605:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788330353.245322:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788330353.449639:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1788330353.756240:0:18687:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788330353.756454:0:18687:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788330354.267856:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788330354.400766:0:17101:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788330354.400774:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99eee721d800 from 9 10000000:01000000:2.0:1788330354.400779:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788330354.400848:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330354.400964:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330354.400986:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330354.401079:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792450304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788330354.401200:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330354.401250:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eedefcc000 going to sleep for 11 seconds 00000100:00100000:3.0:1788330354.401608:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792450304 00000100:00100000:3.0:1788330354.401619:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792450304 00000100:00100000:3.0:1788330354.401716:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788330354.401729:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+19:17101:x1875199792450304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330354.401746:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330354.401776:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2277 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2270 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330354.401806:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2270 expref: 20 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330354.401819:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2270 expref: 20 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330354.401871:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eeef91be00, rc 0) 00000100:00100000:3.0:1788330354.401932:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+20:17101:x1875199792450304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330354.401940:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788330354.402204:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792450304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330354.402221:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2270 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2277 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330354.402232:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2270 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2277 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330354.402304:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792450432:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788330354.402343:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330354.407361:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eedefcc000 going to sleep for 11 seconds 00000100:00100000:1.0:1788330354.414614:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792450432 00000100:00100000:1.0:1788330354.414639:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792450432 00000100:00100000:1.0:1788330354.414728:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788330354.414740:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+20:17101:x1875199792450432:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788330354.414777:0:17095:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788330354.414808:0:17095:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788330354.414811:0:17095:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788330354.415194:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+20:17101:x1875199792450432:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 454us (12848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330354.415203:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788330354.415283:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792450432:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788330354.415374:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788330354.415387:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2270 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2277 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330354.415400:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2277 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330354.415413:0:17101:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788330354.415422:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99edc7d05800 from 9 10000000:01000000:1.0:1788330354.415425:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788330354.415543:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7efc00/0x8475908e9fd227e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330354.415554:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eefe7efc00/0x8475908e9fd227e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330354.415565:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eefe7efc00/0x8475908e9fd227e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330354.415592:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792450560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788330354.415637:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330354.415665:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef403b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788330354.415682:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792450560 00000100:00100000:1.0:1788330354.415686:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792450560 00000100:00100000:1.0:1788330354.415708:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788330354.415715:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+20:17101:x1875199792450560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330354.415727:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330354.415742:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eefe7ee200/0x8475908e9fd2285 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd227e expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330354.415768:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eefe7ee200/0x8475908e9fd2285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd227e expref: 21 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330354.415779:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eefe7ee200/0x8475908e9fd2285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd227e expref: 21 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330354.415790:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eefe7ee200, rc 0) 00000100:00100000:1.0:1788330354.415821:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:17101:x1875199792450560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330354.415845:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788330354.416286:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792450560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330354.416304:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eefe7efc00/0x8475908e9fd227e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2285 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330354.416315:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eefe7efc00/0x8475908e9fd227e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2285 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330354.416366:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792450688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788330354.416402:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330354.416446:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef403b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788330354.416760:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792450688 00000100:00100000:3.0:1788330354.416767:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792450688 00000100:00100000:3.0:1788330354.416812:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788330354.416822:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:17101:x1875199792450688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788330354.416851:0:17095:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788330354.416879:0:17095:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788330354.416883:0:17095:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788330354.416986:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:17101:x1875199792450688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 159us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330354.416995:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788330354.419641:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792450688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788330354.419756:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788330354.419769:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7efc00/0x8475908e9fd227e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2285 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330354.419781:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eefe7efc00/0x8475908e9fd227e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2285 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330355.291475:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330356.317690:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330356.635730:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330341/real 1788330341] req@ffff99edc5ee8000 x1875199792443008/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330356 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330356.635797:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99edc5ee8000 x1875199792443008/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330356 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330356.635821:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330341/real 1788330341] req@ffff99edc5ee8e00 x1875199792443136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330356 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330356.635835:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99edc5ee8e00 x1875199792443136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330356 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788330356.635866:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eec289b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788330356.635896:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788330356.635901:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792443008:0@lo:8:kworker.0 00000100:00080000:0.0:1788330356.635907:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7e25800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788330356.635912:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788330356.635915:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792443136:0@lo:8:kworker.0 00000100:00100000:0.0:1788330356.636273:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792450816:0@lo:400:kworker.0 00000100:00100000:0.0:1788330356.636364:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330356.636574:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330356.636580:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792450944:0@lo:400:kworker.0 00000100:00100000:0.0:1788330356.636611:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330356.636645:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792450944 00000100:00100000:0.0:1788330356.636653:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792450944 00000100:00100000:0.0:1788330356.636721:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788330356.636732:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792450944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330356.636797:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792450944:12345-0@lo:400:kworker.0 Request processed in 66us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330356.636827:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788330356.636880:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792450944:0@lo:400:kworker.0 00000100:00080000:1.0:1788330356.636955:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330356.636961:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788330356.636964:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330356.636976:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788330356.637008:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330356.637018:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788330356.637021:0:36:0:(import.c:65:import_set_state_nolock()) ffff99eec289b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330356.637027:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 545 00000100:00080000:1.0:1788330356.637032:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788330356.637037:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99eec289b000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330356.637065:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eeffd6a300 x1875199792451328/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788330356.637080:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330356.637083:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788330356.637085:0:36:0:(import.c:65:import_set_state_nolock()) ffff99edc7e25800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330356.637089:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 545 00000100:00080000:1.0:1788330356.637092:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788330356.637095:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99edc7e25800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330356.637106:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eeffd69500 x1875199792451456/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788330356.637194:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792451328:0@lo:8:kworker.0 00000100:00100000:1.0:1788330356.637233:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330356.637259:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792451456:0@lo:8:kworker.0 00000100:00100000:1.0:1788330356.637285:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330356.637329:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792451328 00000100:00100000:1.0:1788330356.637333:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792451328 00000100:00100000:1.0:1788330356.637355:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792451456 00000100:00100000:1.0:1788330356.637358:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792451456 00000100:00100000:1.0:1788330356.637370:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788330356.637376:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875199792451328:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788330356.637412:0:18612:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 560 last 0 00000020:00000080:1.0:1788330356.637457:0:18612:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd228c 00002000:00100000:1.0:1788330356.637478:0:18612:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff99eee7276000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788330356.637483:0:18612:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788330356.637487:0:18612:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788330356.637712:0:18612:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788330356.637742:0:18612:0:(import.c:65:import_set_state_nolock()) ffff99eee7271000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788330356.637788:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875199792451328:12345-0@lo:8:kworker.0 Request processed in 410us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330356.637796:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788330356.637821:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788330356.637826:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875199792451456:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788330356.637839:0:18612:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788330356.637996:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792451712:0@lo:400:kworker.0 00000100:00100000:2.0:1788330356.638039:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330356.638066:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788330356.638072:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792451584:0@lo:400:kworker.0 00000100:00100000:2.0:1788330356.638097:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330356.638124:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792451072:0@lo:400:kworker.0 00000100:00100000:2.0:1788330356.638169:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330356.638187:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792451840:0@lo:400:kworker.0 00000100:00100000:2.0:1788330356.638211:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330356.638230:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330356.638235:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792451200:0@lo:400:kworker.0 00000100:00100000:2.0:1788330356.638259:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330356.638292:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792451712 00000100:00100000:2.0:1788330356.638296:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792451712 00000100:00100000:2.0:1788330356.638336:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792451584 00000100:00100000:2.0:1788330356.638339:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792451584 00000100:00100000:2.0:1788330356.638353:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792451072 00000100:00100000:2.0:1788330356.638355:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792451072 00000100:00100000:2.0:1788330356.638366:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792451840 00000100:00100000:2.0:1788330356.638368:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792451840 00000100:00100000:2.0:1788330356.638384:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788330356.638390:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792451712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330356.638428:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792451712:12345-0@lo:400:kworker.0 Request processed in 38us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330356.638442:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788330356.638457:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788330356.638463:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792451584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330356.638489:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792451584:12345-0@lo:400:kworker.0 Request processed in 27us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330356.638494:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788330356.638505:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788330356.638510:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792451072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330356.638539:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792451072:12345-0@lo:400:kworker.0 Request processed in 29us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330356.638544:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788330356.638553:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788330356.638558:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792451840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330356.638582:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792451840:12345-0@lo:400:kworker.0 Request processed in 24us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330356.638587:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788330356.638616:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788330356.638621:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788330356.638641:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eeffd69880 x1875199792451584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330356.638653:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792451584:0@lo:400:kworker.0 00010000:00080000:2.0:1788330356.638662:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eeffd68000 x1875199792451712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330356.638670:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792451712:0@lo:400:kworker.0 00010000:00080000:2.0:1788330356.638705:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eeffd69f80 x1875199792451072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330356.638714:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792451072:0@lo:400:kworker.0 00010000:00080000:2.0:1788330356.638724:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eeffd68a80 x1875199792451840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330356.638732:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792451840:0@lo:400:kworker.0 00000100:00100000:0.0:1788330356.639083:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792451200 00000100:00100000:0.0:1788330356.639088:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792451200 00000100:00100000:0.0:1788330356.639124:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788330356.639131:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792451200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330356.639188:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792451200:12345-0@lo:400:kworker.0 Request processed in 58us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330356.639194:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788330356.639233:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792451200:0@lo:400:kworker.0 00010000:00080000:0.0:1788330356.639280:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eeffd6a300 x1875199792451328/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788330376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330356.639291:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788330356.639300:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788330356.639311:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788330356.639318:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788330356.639322:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eec289b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788330356.639339:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788330356.639345:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792451328:0@lo:8:kworker.0 00000004:00080000:0.0:1788330356.639406:0:17846:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788330356.639429:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17846:1875199792452096:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788330356.639455:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330356.639472:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eecaf9acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330356.639491:0:18610:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788330356.639504:0:18610:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788330356.639515:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330356.639522:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792451968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788330356.639547:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330356.639583:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792451968 00000100:00100000:0.0:1788330356.639586:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792451968 00000100:00100000:0.0:1788330356.639615:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788330356.639622:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875199792451968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788330356.639645:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788330356.639680:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875199792451968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330356.639686:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788330356.639701:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788330356.639717:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eefd32ea00 x1875199792451968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330356.639731:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792451968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330356.639905:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792450816 00000100:00100000:3.0:1788330356.639911:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792450816 00000100:00100000:3.0:1788330356.639939:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788330356.639946:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:3648:x1875199792450816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330356.639997:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:3648:x1875199792450816:12345-0@lo:400:kworker.0 Request processed in 52us (3633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330356.640004:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788330356.640199:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792450816:0@lo:400:kworker.0 00000004:00080000:2.0:1788330356.641626:0:17845:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788330356.641764:0:17845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 560613612385ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788330356.641786:0:17845:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788330356.641953:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792452096 00000100:00100000:0.0:1788330356.641964:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792452096 00000100:00100000:2.0:1788330356.643709:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788330356.643730:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17846:x1875199792452096:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788330356.645556:0:17837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788330356.655625:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875199792451456:12345-0@lo:8:kworker.0 Request processed in 17783us (18325us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788330356.655646:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00080000:0.0:1788330356.657456:0:18802:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788330356.657468:0:18802:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788330356.657590:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17846:x1875199792452096:12345-0@lo:7:osp-pre-0-1.0 Request processed in 13861us (18127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330356.657604:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788330356.657679:0:17846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eefd32c000 x1875199792452096/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788330372 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330356.657697:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17846:1875199792452096:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788330356.657717:0:17846:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788330356.657782:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17846:1875199792452224:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788330356.657837:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330356.657934:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eecaf9acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330356.657961:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792452224 00000100:00100000:0.0:1788330356.657971:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792452224 00000100:00100000:0.0:1788330356.658029:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788330356.658042:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17846:x1875199792452224:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788330356.658083:0:18610:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788330356.658116:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17846:x1875199792452224:12345-0@lo:5:osp-pre-0-1.0 Request processed in 78us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330356.658123:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788330356.658174:0:17846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eefd32c000 x1875199792452224/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788330372 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330356.658185:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17846:1875199792452224:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788330356.658194:0:17846:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788330356.658387:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17846:1875199792452352:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788330356.658412:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330356.658428:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eecaf9acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330356.658441:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792452352 00000100:00100000:0.0:1788330356.658445:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792452352 00000100:00100000:0.0:1788330356.658472:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788330356.658479:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17846:x1875199792452352:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788330356.658508:0:18610:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00080000:2.0:1788330356.658792:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7e25800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788330356.658799:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788330356.658803:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792451456:0@lo:8:kworker.0 00000001:00080000:1.0:1788330356.686049:0:18607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1788330356.686070:0:18607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788330356.689538:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17846:x1875199792452352:12345-0@lo:5:osp-pre-0-1.0 Request processed in 31044us (31109us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788330356.689560:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788330356.689671:0:17846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eefd32c000 x1875199792452352/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788330372 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330356.689686:0:17846:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788330356.689709:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17846:1875199792452352:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788330356.689731:0:17846:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1788330356.689812:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17846:1875199792452480:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788330356.689936:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330356.690017:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eecaf9acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330356.690091:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792452480 00000100:00100000:1.0:1788330356.690100:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792452480 00000100:00100000:1.0:1788330356.690230:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788330356.690243:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17846:x1875199792452480:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788330356.690470:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17846:x1875199792452480:12345-0@lo:900:osp-pre-0-1.0 Request processed in 229us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330356.690478:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788330356.690568:0:17846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eefd32c000 x1875199792452480/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788330372 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330356.690579:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17846:1875199792452480:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1788330357.339462:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330357.659965:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792452608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330357.660080:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330357.660535:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792452608 00000100:00100000:1.0:1788330357.660548:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792452608 00000100:00100000:1.0:1788330357.660636:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788330357.660649:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792452608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788330357.660697:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788330357.660789:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792452608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330357.660805:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788330357.661037:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792452608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330357.671350:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788330357.671382:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792452736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330357.671488:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330357.673102:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792452736 00000100:00100000:3.0:1788330357.673125:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792452736 00000100:00100000:3.0:1788330357.673228:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788330357.673242:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792452736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788330357.673298:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788330357.674208:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792452736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 964us (2714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330357.674219:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788330357.676020:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792452736:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788330357.788236:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788330358.363360:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330359.392047:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788330360.127565:0:18978:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788330360.415496:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330360.733329:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330340/real 1788330340] req@ffff99edc7e75500 x1875199792441856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330360 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330360.733376:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99edc7e75500 x1875199792441856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330360 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330360.733388:0:3645:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330340/real 1788330340] req@ffff99edc7e75f80 x1875199792441984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330360 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330360.733400:0:3645:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99edc7e75f80 x1875199792441984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330360 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788330360.733425:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eee7217000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330360.733453:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788330360.733457:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792441856:0@lo:8:kworker.0 00000100:00080000:1.0:1788330360.733464:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eee721f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330360.733469:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788330360.733472:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792441984:0@lo:8:kworker.0 00000100:00080000:3.0:1788330360.733665:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330360.733670:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788330360.733673:0:37:0:(import.c:65:import_set_state_nolock()) ffff99eee7217000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788330360.733686:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 544 00000100:00080000:3.0:1788330360.733693:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788330360.733701:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99eee7217000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330360.733727:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eee7642d80 x1875199792453120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788330360.733740:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330360.733743:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788330360.733745:0:37:0:(import.c:65:import_set_state_nolock()) ffff99eee721f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788330360.733748:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 544 00000100:00080000:3.0:1788330360.733750:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788330360.733754:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99eee721f000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330360.733763:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eee7643480 x1875199792453248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788330360.733814:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330360.733817:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788330360.733819:0:37:0:(import.c:65:import_set_state_nolock()) ffff99edc7e25800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788330360.733822:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 560 00000100:00080000:3.0:1788330360.733825:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788330360.733829:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99edc7e25800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:3.0:1788330360.733838:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eee7640e00 x1875199792453760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788330360.733882:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792453504:0@lo:400:kworker.0 00000100:00100000:3.0:1788330360.733973:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330360.734038:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792454144:0@lo:400:kworker.0 00000100:00100000:3.0:1788330360.734082:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330360.734107:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788330360.734113:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792453376:0@lo:400:kworker.0 00000100:00100000:3.0:1788330360.734136:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330360.734176:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792454016:0@lo:400:kworker.0 00000100:00100000:3.0:1788330360.734203:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330360.734236:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792453504 00000100:00100000:3.0:1788330360.734246:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792453504 00000100:00100000:3.0:1788330360.734307:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788330360.734317:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792453504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330360.734379:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792453504:12345-0@lo:400:kworker.0 Request processed in 62us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330360.734388:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788330360.734415:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792454144 00000100:00100000:3.0:1788330360.734419:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792454144 00000100:00100000:3.0:1788330360.734457:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792453376 00000100:00100000:3.0:1788330360.734460:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792453376 00000100:00100000:3.0:1788330360.734473:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792454016 00000100:00100000:3.0:1788330360.734476:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792454016 00000100:00100000:3.0:1788330360.734493:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788330360.734499:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792454144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330360.734530:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792454144:12345-0@lo:400:kworker.0 Request processed in 31us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330360.734537:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788330360.734549:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788330360.734555:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792453376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330360.734582:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792453376:12345-0@lo:400:kworker.0 Request processed in 28us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330360.734598:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788330360.734611:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788330360.734617:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792454016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330360.734644:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875199792454016:12345-0@lo:400:kworker.0 Request processed in 28us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330360.734651:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788330360.734692:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eee7642300 x1875199792453376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330360.734705:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792453376:0@lo:400:kworker.0 00010000:00080000:3.0:1788330360.734717:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eee7643800 x1875199792454016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330360.734725:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875199792454016:0@lo:400:kworker.0 00000100:00100000:3.0:1788330360.734734:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792453504:0@lo:400:kworker.0 00010000:00080000:3.0:1788330360.734743:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eee7642680 x1875199792454144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330360.734750:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792454144:0@lo:400:kworker.0 00000100:00100000:0.0:1788330360.734869:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792452864:0@lo:400:kworker.0 00000100:00100000:0.0:1788330360.734912:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330360.734950:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792453632:0@lo:400:kworker.0 00000100:00100000:0.0:1788330360.734977:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330360.734999:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788330360.735005:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792452992:0@lo:400:kworker.0 00000100:00100000:0.0:1788330360.735026:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330360.735043:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792453888:0@lo:400:kworker.0 00000100:00100000:0.0:1788330360.735064:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330360.735094:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792453888 00000100:00100000:0.0:1788330360.735098:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792453888 00000100:00100000:0.0:1788330360.735125:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788330360.735131:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792453888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330360.735193:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792453888:12345-0@lo:400:kworker.0 Request processed in 62us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330360.735200:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788330360.735225:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330360.735230:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788330360.735243:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792453632 00000100:00100000:0.0:1788330360.735253:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792453632 00000100:00100000:0.0:1788330360.735286:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788330360.735292:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792453632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330360.735321:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792453632:12345-0@lo:400:kworker.0 Request processed in 30us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330360.735328:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788330360.735348:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330360.735355:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792452992 00000100:00100000:0.0:1788330360.735358:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792452992 00000100:00100000:0.0:1788330360.735380:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788330360.735387:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792452992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330360.735417:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792452992:12345-0@lo:400:kworker.0 Request processed in 30us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330360.735422:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788330360.735449:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792452992:0@lo:400:kworker.0 00010000:00080000:0.0:1788330360.735460:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eee7641880 x1875199792453888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330360.735468:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792453888:0@lo:400:kworker.0 00010000:00080000:0.0:1788330360.735477:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eee7641180 x1875199792453632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330360.735484:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792453632:0@lo:400:kworker.0 00000100:00100000:1.0:1788330360.735591:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792453120:0@lo:8:kworker.0 00000100:00100000:1.0:1788330360.735624:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330360.735663:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792453248:0@lo:8:kworker.0 00000100:00100000:1.0:1788330360.735687:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330360.735707:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792453760:0@lo:8:kworker.0 00000100:00100000:1.0:1788330360.735728:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330360.735756:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792453120 00000100:00100000:1.0:1788330360.735759:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792453120 00000100:00100000:1.0:1788330360.735790:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792453248 00000100:00100000:1.0:1788330360.735794:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792453248 00000100:00100000:1.0:1788330360.735801:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792453760 00000100:00100000:1.0:1788330360.735803:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792453760 00000100:00100000:1.0:1788330360.735812:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788330360.735817:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875199792453120:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788330360.735848:0:18610:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 564 last 0 00000020:00000080:1.0:1788330360.735885:0:18610:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd2293 00002000:00100000:1.0:1788330360.735906:0:18610:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99eec91d2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788330360.735910:0:18610:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788330360.735914:0:18610:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788330360.736010:0:18610:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788330360.736044:0:18610:0:(import.c:65:import_set_state_nolock()) ffff99eec91d6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788330360.736087:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875199792453120:12345-0@lo:8:kworker.0 Request processed in 268us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330360.736093:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788330360.736106:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788330360.736110:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875199792453248:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788330360.736132:0:18610:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788330360.736187:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875199792453248:12345-0@lo:8:kworker.0 Request processed in 76us (500us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788330360.736193:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788330360.736204:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788330360.736208:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875199792453760:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788330360.736217:0:18610:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788330360.736240:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875199792453760:12345-0@lo:8:kworker.0 Request processed in 30us (511us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788330360.736246:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788330360.736273:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eee7642d80 x1875199792453120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788330385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330360.736283:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788330360.736291:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788330360.736301:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788330360.736308:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788330360.736311:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eee7217000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788330360.736326:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788330360.736331:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792453120:0@lo:8:kworker.0 00000100:00080000:1.0:1788330360.736341:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eee721f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330360.736345:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788330360.736348:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7643480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792453248:0@lo:8:kworker.0 00000100:00080000:1.0:1788330360.736356:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7e25800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788330360.736359:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788330360.736369:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792453760:0@lo:8:kworker.0 00000004:00080000:1.0:1788330360.736396:0:17127:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788330360.736469:0:17127:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 564708317981ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788330360.736477:0:17127:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788330360.736742:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792452864 00000100:00100000:3.0:1788330360.736748:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792452864 00000100:00100000:3.0:1788330360.736799:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788330360.736808:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:3646:x1875199792452864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330360.736851:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:3646:x1875199792452864:12345-0@lo:400:kworker.0 Request processed in 45us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330360.736858:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000004:00080000:3.0:1788330360.736931:0:17128:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788330360.736952:0:17128:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17128:1875199792454400:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788330360.736979:0:17128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330360.736996:0:17128:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc5d023c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330360.741092:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330360.741137:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792454272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330360.741269:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330360.741344:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792454272 00000100:00100000:1.0:1788330360.741354:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792454272 00000100:00100000:1.0:1788330360.741424:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788330360.741434:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875199792454272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330360.741473:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788330360.741524:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875199792454272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330360.741532:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788330360.741558:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788330360.741747:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc75fe680 x1875199792454272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330360.741781:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792454272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330360.741817:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792454400 00000100:00100000:1.0:1788330360.741821:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792454400 00000100:00100000:1.0:1788330360.741850:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788330360.741857:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17128:x1875199792454400:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788330360.742892:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792452864:0@lo:400:kworker.0 00002000:00080000:0.0:1788330360.757318:0:18610:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788330360.757341:0:18610:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788330360.757351:0:18610:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000004:00080000:1.0:1788330360.766299:0:17083:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788330360.781386:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330360.781407:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d365a152/0x8475908e9fd229a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.781431:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1788330360.781437:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330360.781446:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d365a152/0x8475908e9fd229a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.781468:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d365a152/0x8475908e9fd229a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.781482:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d365a152/0x8475908e9fd229a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.781492:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d365a152/0x8475908e9fd229a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.781517:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330360.782411:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330360.782423:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d365a152/0x8475908e9fd229a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.782438:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330360.782444:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d365a152/0x8475908e9fd229a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.782472:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d365a152/0x8475908e9fd229a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.782501:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d365a152/0x8475908e9fd229a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.782510:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d365a152/0x8475908e9fd229a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.782538:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330360.782540:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330360.782542:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788330360.789572:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788330360.789596:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000067128d6/0x8475908e9fd22a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.789620:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1788330360.789626:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330360.789633:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000067128d6/0x8475908e9fd22a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.789649:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000067128d6/0x8475908e9fd22a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.789659:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000067128d6/0x8475908e9fd22a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.789678:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000067128d6/0x8475908e9fd22a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.789709:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330360.789743:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330360.789754:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000067128d6/0x8475908e9fd22a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.789775:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330360.789782:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000067128d6/0x8475908e9fd22a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.789794:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000067128d6/0x8475908e9fd22a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.789834:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000067128d6/0x8475908e9fd22a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.789843:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000067128d6/0x8475908e9fd22a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.789882:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.789885:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.789887:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788330360.791436:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788330360.791453:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55fd445/0x8475908e9fd22a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.791469:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1788330360.791474:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330360.791481:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55fd445/0x8475908e9fd22a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.791497:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b55fd445/0x8475908e9fd22a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.791508:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55fd445/0x8475908e9fd22a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.791515:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b55fd445/0x8475908e9fd22a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.791760:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330360.791778:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b55fd445/0x8475908e9fd22a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.791815:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039e00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330360.791821:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55fd445/0x8475908e9fd22a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.791831:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55fd445/0x8475908e9fd22a8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.791859:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b55fd445/0x8475908e9fd22a8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.791871:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.791873:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.791875:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330360.791999:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330360.792005:0:18610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b55fd445/0x8475908e9fd22a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788330360.792639:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788330360.792647:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd02a6c5/0x8475908e9fd22af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.792656:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1788330360.792661:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330360.792665:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd02a6c5/0x8475908e9fd22af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.792677:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd02a6c5/0x8475908e9fd22af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.792686:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd02a6c5/0x8475908e9fd22af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.792695:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd02a6c5/0x8475908e9fd22af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.792721:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330360.792822:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330360.792829:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd02a6c5/0x8475908e9fd22af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.792838:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330360.792843:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd02a6c5/0x8475908e9fd22af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.792860:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd02a6c5/0x8475908e9fd22af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.792876:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd02a6c5/0x8475908e9fd22af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.792895:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd02a6c5/0x8475908e9fd22af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.792915:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.792917:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.792919:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788330360.793241:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788330360.793246:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005acef29b/0x8475908e9fd22b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.793252:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1788330360.793255:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330360.793264:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005acef29b/0x8475908e9fd22b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.793275:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005acef29b/0x8475908e9fd22b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.793283:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005acef29b/0x8475908e9fd22b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.793290:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005acef29b/0x8475908e9fd22b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.793314:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330360.793347:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330360.793354:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005acef29b/0x8475908e9fd22b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.793364:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330360.793368:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005acef29b/0x8475908e9fd22b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.793378:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005acef29b/0x8475908e9fd22b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.793390:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005acef29b/0x8475908e9fd22b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.793399:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005acef29b/0x8475908e9fd22b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.793415:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.793417:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.793419:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788330360.793581:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788330360.793585:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b18a6de4/0x8475908e9fd22bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.793592:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1788330360.793595:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330360.793598:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b18a6de4/0x8475908e9fd22bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.793605:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b18a6de4/0x8475908e9fd22bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.793610:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b18a6de4/0x8475908e9fd22bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.793626:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b18a6de4/0x8475908e9fd22bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.793638:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330360.793644:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330360.793647:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b18a6de4/0x8475908e9fd22bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.793652:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330360.793655:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b18a6de4/0x8475908e9fd22bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.793659:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b18a6de4/0x8475908e9fd22bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.793667:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b18a6de4/0x8475908e9fd22bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.793671:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b18a6de4/0x8475908e9fd22bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.793681:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330360.793682:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330360.793683:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788330360.794064:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788330360.794073:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056ef6306/0x8475908e9fd22c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.794079:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1788330360.794082:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330360.794085:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056ef6306/0x8475908e9fd22c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.794091:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056ef6306/0x8475908e9fd22c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.794096:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056ef6306/0x8475908e9fd22c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.794101:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056ef6306/0x8475908e9fd22c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.794214:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788330360.794549:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788330360.794556:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd22cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.794565:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1788330360.794567:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330360.794572:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd22cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.794581:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd22cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.794596:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd22cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.794602:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd22cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.794618:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788330360.794748:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788330360.794756:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056ef6306/0x8475908e9fd22c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.794787:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330360.794792:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056ef6306/0x8475908e9fd22c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.794801:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056ef6306/0x8475908e9fd22c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.794821:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056ef6306/0x8475908e9fd22c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.794829:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056ef6306/0x8475908e9fd22c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.794848:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330360.794852:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd22cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.794859:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039c00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330360.794862:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd22cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.794871:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd22cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.794881:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd22cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.794897:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd22cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.794913:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330360.794915:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330360.794917:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788330360.795522:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788330360.795531:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bf2f757/0x8475908e9fd22d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.795545:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1788330360.795549:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330360.795554:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bf2f757/0x8475908e9fd22d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.795567:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bf2f757/0x8475908e9fd22d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.795576:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bf2f757/0x8475908e9fd22d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.795584:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bf2f757/0x8475908e9fd22d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.795623:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788330360.796244:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330360.796253:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bf2f757/0x8475908e9fd22d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.796263:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330360.796268:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bf2f757/0x8475908e9fd22d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.796279:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bf2f757/0x8475908e9fd22d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.796297:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bf2f757/0x8475908e9fd22d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.796304:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bf2f757/0x8475908e9fd22d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.796313:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330360.796324:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330360.796326:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330360.796328:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330360.810426:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330360.810448:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a472155f/0x8475908e9fd22d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.810471:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1788330360.810476:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330360.810483:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a472155f/0x8475908e9fd22d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.810522:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a472155f/0x8475908e9fd22d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.810536:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a472155f/0x8475908e9fd22d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.810545:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a472155f/0x8475908e9fd22d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.811287:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788330360.816640:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330360.816663:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fe00cb2/0x8475908e9fd22e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.816908:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1788330360.816914:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330360.816924:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fe00cb2/0x8475908e9fd22e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.817017:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fe00cb2/0x8475908e9fd22e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.817030:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fe00cb2/0x8475908e9fd22e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.817062:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fe00cb2/0x8475908e9fd22e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.818253:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788330360.818281:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a472155f/0x8475908e9fd22d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.818295:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1326800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330360.818302:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a472155f/0x8475908e9fd22d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.818314:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a472155f/0x8475908e9fd22d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.818339:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a472155f/0x8475908e9fd22d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.818347:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a472155f/0x8475908e9fd22d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.822121:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330360.822142:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fe00cb2/0x8475908e9fd22e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.822176:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330360.822183:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fe00cb2/0x8475908e9fd22e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.822196:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fe00cb2/0x8475908e9fd22e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.822226:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fe00cb2/0x8475908e9fd22e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.822238:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330360.822240:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330360.822243:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330360.825189:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788330360.825212:0:18610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fe00cb2/0x8475908e9fd22e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788330360.832120:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330360.832140:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec4ea34b/0x8475908e9fd22e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.832179:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1788330360.832185:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330360.832193:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec4ea34b/0x8475908e9fd22e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.832213:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec4ea34b/0x8475908e9fd22e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.832240:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec4ea34b/0x8475908e9fd22e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.832249:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec4ea34b/0x8475908e9fd22e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.832361:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330360.832372:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec4ea34b/0x8475908e9fd22e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.832382:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330360.832387:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec4ea34b/0x8475908e9fd22e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.832397:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec4ea34b/0x8475908e9fd22e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.832417:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec4ea34b/0x8475908e9fd22e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.832429:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.832430:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.832432:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330360.832972:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788330360.832980:0:18610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec4ea34b/0x8475908e9fd22e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.834308:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330360.838603:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330360.838627:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd22ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.838653:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1788330360.838659:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330360.838667:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd22ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.838697:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd22ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.838718:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd22ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.838754:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd22ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.838796:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330360.838991:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330360.839000:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd22ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.839009:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee600 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330360.839014:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd22ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.839032:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd22ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.839054:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd22ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.839062:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d3988fc/0x8475908e9fd22ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.839085:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330360.839087:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330360.839089:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330360.842684:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330360.842713:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010bde119/0x8475908e9fd22f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.842743:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1788330360.842748:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330360.842757:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010bde119/0x8475908e9fd22f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.842784:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010bde119/0x8475908e9fd22f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.842795:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010bde119/0x8475908e9fd22f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.842803:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010bde119/0x8475908e9fd22f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.842822:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330360.842987:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330360.842997:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010bde119/0x8475908e9fd22f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.843005:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef600 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330360.843011:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010bde119/0x8475908e9fd22f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.843020:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010bde119/0x8475908e9fd22f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.843054:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010bde119/0x8475908e9fd22f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.843062:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010bde119/0x8475908e9fd22f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.843094:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.843096:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.843098:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330360.843555:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330360.843562:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd22fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.843578:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1788330360.843581:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330360.843585:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd22fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.843595:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd22fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.843603:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd22fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.843610:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd22fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.843631:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330360.844025:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330360.844034:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd22fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.844044:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7eee00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330360.844048:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd22fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.844057:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd22fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.844072:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd22fc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.844094:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ac33959/0x8475908e9fd22fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.844114:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330360.844116:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330360.844117:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330360.844305:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330360.844312:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee97ca1a/0x8475908e9fd2303 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.844322:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1788330360.844325:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330360.844330:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee97ca1a/0x8475908e9fd2303 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.844342:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee97ca1a/0x8475908e9fd2303 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.844362:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee97ca1a/0x8475908e9fd2303 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.844370:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee97ca1a/0x8475908e9fd2303 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.844426:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788330360.848095:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330360.848115:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd230a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.848139:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1788330360.848145:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330360.848167:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd230a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.848187:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd230a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.848199:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd230a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.848208:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd230a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.852221:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788330360.852243:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee97ca1a/0x8475908e9fd2303 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.852273:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330360.852280:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee97ca1a/0x8475908e9fd2303 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.852292:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee97ca1a/0x8475908e9fd2303 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.852320:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee97ca1a/0x8475908e9fd2303 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.852327:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee97ca1a/0x8475908e9fd2303 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.852412:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330360.852420:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd230a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.852429:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330360.852433:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd230a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.852441:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd230a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.852454:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd230a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.852463:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.852465:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.852467:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.853337:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330360.853820:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788330360.853835:0:18610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd230a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788330360.857111:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788330360.857132:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000210efb1f/0x8475908e9fd2311 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.857172:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=564s v=(0 0) 00010000:00010000:3.0:1788330360.857178:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330360.857186:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000210efb1f/0x8475908e9fd2311 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.857203:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000210efb1f/0x8475908e9fd2311 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.857214:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000210efb1f/0x8475908e9fd2311 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.857221:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000210efb1f/0x8475908e9fd2311 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.857245:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330360.857966:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330360.857977:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000210efb1f/0x8475908e9fd2311 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.857995:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91b600 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330360.858002:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000210efb1f/0x8475908e9fd2311 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.858012:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000210efb1f/0x8475908e9fd2311 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.858035:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000210efb1f/0x8475908e9fd2311 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.858044:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000210efb1f/0x8475908e9fd2311 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.858066:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330360.858068:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330360.858070:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330360.864378:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330360.864400:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec4ea34b/0x8475908e9fd2318 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.864423:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1788330360.864428:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330360.864436:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec4ea34b/0x8475908e9fd2318 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.864452:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec4ea34b/0x8475908e9fd2318 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.864463:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec4ea34b/0x8475908e9fd2318 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.864471:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec4ea34b/0x8475908e9fd2318 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.864489:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330360.864960:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330360.864970:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec4ea34b/0x8475908e9fd2318 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.864979:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330360.864985:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec4ea34b/0x8475908e9fd2318 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.865009:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec4ea34b/0x8475908e9fd2318 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.865030:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec4ea34b/0x8475908e9fd2318 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.865039:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec4ea34b/0x8475908e9fd2318 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.865061:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.865075:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.865077:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330360.865950:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330360.865963:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062486e6c/0x8475908e9fd231f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.865983:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1788330360.865987:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330360.865993:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062486e6c/0x8475908e9fd231f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.866005:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062486e6c/0x8475908e9fd231f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.866013:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062486e6c/0x8475908e9fd231f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.866020:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062486e6c/0x8475908e9fd231f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.866043:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330360.866249:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330360.866256:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062486e6c/0x8475908e9fd231f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.866264:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330360.866269:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062486e6c/0x8475908e9fd231f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.866277:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062486e6c/0x8475908e9fd231f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.866294:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062486e6c/0x8475908e9fd231f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.866315:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062486e6c/0x8475908e9fd231f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.866338:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.866340:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.866341:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330360.873406:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330360.873427:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd2326 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.873451:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1788330360.873456:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330360.873463:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd2326 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.873480:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd2326 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.873508:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd2326 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.873517:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd2326 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.873545:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330360.873991:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330360.874002:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd2326 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.874012:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330360.874018:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd2326 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.874029:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd2326 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.874065:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd2326 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.874073:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098ca4b7b/0x8475908e9fd2326 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.874094:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330360.874097:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330360.874098:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330360.876265:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330360.876289:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a4bf75/0x8475908e9fd232d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.876313:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1788330360.876318:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330360.876326:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a4bf75/0x8475908e9fd232d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.876344:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2a4bf75/0x8475908e9fd232d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.876356:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a4bf75/0x8475908e9fd232d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.876364:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a4bf75/0x8475908e9fd232d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.876405:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330360.876962:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330360.876973:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2a4bf75/0x8475908e9fd232d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.876985:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330360.876990:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a4bf75/0x8475908e9fd232d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.877000:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a4bf75/0x8475908e9fd232d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.877021:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2a4bf75/0x8475908e9fd232d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.877030:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2a4bf75/0x8475908e9fd232d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.877052:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.877054:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.877055:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788330360.884255:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788330360.884291:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b18a6de4/0x8475908e9fd2334 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.884314:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1788330360.884319:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330360.884326:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b18a6de4/0x8475908e9fd2334 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.884345:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b18a6de4/0x8475908e9fd2334 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.884356:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b18a6de4/0x8475908e9fd2334 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.884364:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b18a6de4/0x8475908e9fd2334 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.884409:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330360.885650:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330360.885667:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b18a6de4/0x8475908e9fd2334 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.885694:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330360.885700:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b18a6de4/0x8475908e9fd2334 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.885711:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b18a6de4/0x8475908e9fd2334 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.885739:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b18a6de4/0x8475908e9fd2334 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.885748:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b18a6de4/0x8475908e9fd2334 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.885792:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.885794:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.885796:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788330360.886121:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788330360.886131:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55fd445/0x8475908e9fd233b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.886145:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1788330360.886165:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330360.886174:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b55fd445/0x8475908e9fd233b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.886190:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b55fd445/0x8475908e9fd233b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.886200:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b55fd445/0x8475908e9fd233b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.886210:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b55fd445/0x8475908e9fd233b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.886229:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788330360.886282:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330360.886291:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b55fd445/0x8475908e9fd233b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.886300:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039e00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330360.886303:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55fd445/0x8475908e9fd233b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.886311:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b55fd445/0x8475908e9fd233b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.886325:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b55fd445/0x8475908e9fd233b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.886333:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b55fd445/0x8475908e9fd233b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.886349:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330360.886350:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330360.886352:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788330360.887528:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788330360.887543:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bf2f757/0x8475908e9fd2342 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.887561:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1788330360.887579:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330360.887586:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bf2f757/0x8475908e9fd2342 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.887601:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bf2f757/0x8475908e9fd2342 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.887613:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bf2f757/0x8475908e9fd2342 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.887621:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bf2f757/0x8475908e9fd2342 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.887646:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330360.888333:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330360.888348:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bf2f757/0x8475908e9fd2342 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.888361:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330360.888365:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bf2f757/0x8475908e9fd2342 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.888408:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bf2f757/0x8475908e9fd2342 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.888431:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bf2f757/0x8475908e9fd2342 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.888439:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bf2f757/0x8475908e9fd2342 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.888467:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.888468:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.888470:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788330360.890378:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788330360.890392:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd2349 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.890409:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1788330360.890413:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330360.890418:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd2349 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.890430:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd2349 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.890438:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd2349 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.890461:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd2349 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.890484:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330360.890569:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330360.890586:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd2349 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.890603:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039c00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330360.890609:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd2349 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.890621:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd2349 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.890644:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd2349 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.890687:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009747c4b9/0x8475908e9fd2349 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330360.890719:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.890721:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330360.890723:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788330360.898204:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788330360.898223:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056ef6306/0x8475908e9fd2350 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.898241:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=564s v=(0 0) 00010000:00010000:2.0:1788330360.898246:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330360.898252:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056ef6306/0x8475908e9fd2350 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.898267:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056ef6306/0x8475908e9fd2350 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.898277:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056ef6306/0x8475908e9fd2350 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.898284:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056ef6306/0x8475908e9fd2350 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330360.898315:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330360.899356:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330360.899374:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056ef6306/0x8475908e9fd2350 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788330360.899530:0:18610:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330360.899541:0:18610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf0cb136/0x8475908e9fd2357 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.899556:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=564s v=(0 0) 00010000:00010000:1.0:1788330360.899572:0:18610:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330360.899580:0:18610:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf0cb136/0x8475908e9fd2357 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.899595:0:18610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf0cb136/0x8475908e9fd2357 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.899605:0:18610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf0cb136/0x8475908e9fd2357 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.899612:0:18610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf0cb136/0x8475908e9fd2357 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330360.899637:0:18610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788330360.899740:0:18610:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:1.0:1788330360.899885:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17128:x1875199792454400:12345-0@lo:5:osp-pre-0-0.0 Request processed in 158023us (162899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330360.899897:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788330360.900246:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330360.900253:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056ef6306/0x8475908e9fd2350 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.900265:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056ef6306/0x8475908e9fd2350 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.900290:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056ef6306/0x8475908e9fd2350 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.900298:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056ef6306/0x8475908e9fd2350 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.900325:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330360.900338:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf0cb136/0x8475908e9fd2357 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.900345:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7eea00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330360.900348:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf0cb136/0x8475908e9fd2357 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.900355:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf0cb136/0x8475908e9fd2357 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.900365:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf0cb136/0x8475908e9fd2357 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.900371:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf0cb136/0x8475908e9fd2357 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330360.900386:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330360.900387:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330360.900389:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330360.900443:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330360.900524:0:17128:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17128:1875199792454400:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788330360.900547:0:17128:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788330360.900608:0:17128:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17128:1875199792454528:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788330360.900661:0:17128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330360.900701:0:17128:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc5d023c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330360.905253:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792454528 00000100:00100000:1.0:1788330360.905281:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792454528 00000100:00100000:1.0:1788330360.905366:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788330360.905381:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17128:x1875199792454528:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788330360.905449:0:18613:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:0.0:1788330360.934490:0:18607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1788330360.934563:0:18607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788330360.934843:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17128:x1875199792454528:12345-0@lo:5:osp-pre-0-0.0 Request processed in 29457us (34174us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788330360.934857:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788330360.934941:0:17128:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788330360.934960:0:17128:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17128:1875199792454528:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788330360.934985:0:17128:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000020:00000004:2.0:1788330361.421637:0:19030:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788330361.421900:0:19030:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788330361.437114:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330361.755485:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330361.755514:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792454656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788330361.755588:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330361.755627:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792454656 00000100:00100000:0.0:1788330361.755634:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792454656 00000100:00100000:0.0:1788330361.755767:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788330361.755778:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792454656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788330361.755801:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788330361.755836:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792454656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330361.755841:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788330361.755880:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792454656:0@lo:13:osp-pre-0-1.0 00000020:00000004:2.0:1788330362.418040:0:19080:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788330362.419745:0:19080:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788330362.459288:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330362.789652:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330362.789677:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792454784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330362.789766:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330362.790312:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792454784 00000100:00100000:0.0:1788330362.790323:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792454784 00000100:00100000:0.0:1788330362.790383:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788330362.790403:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792454784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788330362.790441:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788330362.790496:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792454784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330362.790504:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788330362.790553:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792454784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330362.790597:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792454912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330362.790624:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330362.790652:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792454912 00000100:00100000:0.0:1788330362.790656:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792454912 00000100:00100000:0.0:1788330362.790691:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788330362.790696:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792454912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330362.790713:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788330362.790744:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792454912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330362.790763:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788330362.790790:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792454912:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788330363.483947:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788330363.683191:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788330364.508612:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330365.531328:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788330365.853257:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330365.853266:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788330365.853270:0:37:0:(import.c:65:import_set_state_nolock()) ffff99eee721f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330365.853285:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 564 00000100:00080000:1.0:1788330365.853290:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788330365.853296:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99eee721f000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330365.853322:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eeffd68a80 x1875199792455424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788330365.853357:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330365.853360:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788330365.853362:0:37:0:(import.c:65:import_set_state_nolock()) ffff99edc7e25800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330365.853366:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 564 00000100:00080000:1.0:1788330365.853368:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788330365.853372:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99edc7e25800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330365.856882:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7e75f80 x1875199792455936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788330365.856967:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792455040:0@lo:400:kworker.0 00000100:00100000:1.0:1788330365.857047:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330365.858325:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792455680:0@lo:400:kworker.0 00000100:00100000:1.0:1788330365.858380:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330365.858415:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792456320:0@lo:400:kworker.0 00000100:00100000:1.0:1788330365.858446:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330365.858474:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788330365.858481:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792455168:0@lo:400:kworker.0 00000100:00100000:1.0:1788330365.858505:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330365.858524:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792455808:0@lo:400:kworker.0 00000100:00100000:1.0:1788330365.858549:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330365.858593:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792455296:0@lo:400:kworker.0 00000100:00100000:1.0:1788330365.858619:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330365.858637:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792456064:0@lo:400:kworker.0 00000100:00100000:1.0:1788330365.858658:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330365.858679:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788330365.858686:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792455552:0@lo:400:kworker.0 00000100:00100000:1.0:1788330365.858710:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330365.858743:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792456192:0@lo:400:kworker.0 00000100:00100000:1.0:1788330365.858776:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330365.858805:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792455424:0@lo:8:kworker.0 00000100:00100000:1.0:1788330365.858831:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330365.858849:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792455936:0@lo:8:kworker.0 00000100:00100000:1.0:1788330365.858871:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330365.858908:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792455040 00000100:00100000:1.0:1788330365.858917:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792455040 00000100:00100000:1.0:1788330365.858970:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788330365.858980:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec909c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:3646:x1875199792455040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330365.859033:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec909c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:3646:x1875199792455040:12345-0@lo:400:kworker.0 Request processed in 54us (1986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330365.859041:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788330365.859074:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792456320 00000100:00100000:1.0:1788330365.859078:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792456320 00000100:00100000:1.0:1788330365.859105:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792456064 00000100:00100000:1.0:1788330365.859107:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792456064 00000100:00100000:1.0:1788330365.859117:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792455552 00000100:00100000:1.0:1788330365.859119:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792455552 00000100:00100000:1.0:1788330365.859133:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792456192 00000100:00100000:1.0:1788330365.859142:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792456192 00000100:00100000:1.0:1788330365.859192:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330365.859202:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792456320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330365.859237:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792456320:12345-0@lo:400:kworker.0 Request processed in 39us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330365.859243:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330365.859255:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788330365.859261:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792456064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330365.859496:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792456064:12345-0@lo:400:kworker.0 Request processed in 236us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330365.859502:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788330365.859514:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788330365.859520:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792455552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330365.859543:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792455552:12345-0@lo:400:kworker.0 Request processed in 24us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330365.859548:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788330365.859558:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788330365.859563:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792456192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330365.859586:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792456192:12345-0@lo:400:kworker.0 Request processed in 24us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330365.859592:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788330365.859615:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792455680 00000100:00100000:1.0:1788330365.859620:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792455680 00000100:00100000:1.0:1788330365.859634:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792455168 00000100:00100000:1.0:1788330365.859637:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792455168 00000100:00100000:1.0:1788330365.859648:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788330365.859877:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792455680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330365.859930:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792455680:12345-0@lo:400:kworker.0 Request processed in 276us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330365.859937:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788330365.859950:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788330365.859955:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792455168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330365.859980:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792455168:12345-0@lo:400:kworker.0 Request processed in 25us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330365.859986:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788330365.860005:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792455808 00000100:00100000:1.0:1788330365.860008:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792455808 00000100:00100000:1.0:1788330365.860027:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792455296 00000100:00100000:1.0:1788330365.860029:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792455296 00000100:00100000:1.0:1788330365.860039:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792455424 00000100:00100000:1.0:1788330365.860042:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792455424 00000100:00100000:1.0:1788330365.860049:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792455936 00000100:00100000:1.0:1788330365.860052:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792455936 00000100:00100000:1.0:1788330365.860059:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788330365.860065:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792455808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330365.860093:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792455808:12345-0@lo:400:kworker.0 Request processed in 28us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330365.860099:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788330365.860109:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788330365.860114:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792455296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330365.860137:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792455296:12345-0@lo:400:kworker.0 Request processed in 23us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330365.860142:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788330365.860185:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788330365.860196:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875199792455424:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788330365.860218:0:18612:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788330365.862690:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792456448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330365.862818:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330365.863295:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792456448 00000100:00100000:3.0:1788330365.863307:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792456448 00000100:00100000:3.0:1788330365.863622:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788330365.863635:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792456448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330365.863679:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788330365.863757:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792456448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330365.863778:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788330365.863846:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792456448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330365.864993:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788330365.865010:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3645:x1875199792455936:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788330365.865060:0:18802:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788330365.865194:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3645:x1875199792455936:12345-0@lo:8:kworker.0 Request processed in 184us (6320us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788330365.865203:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788330365.865243:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7e25800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788330365.865254:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788330365.865260:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792455936:0@lo:8:kworker.0 00000100:00100000:0.0:1788330365.866990:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792455168:0@lo:400:kworker.0 00000100:00100000:0.0:1788330365.867011:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792455808:0@lo:400:kworker.0 00000100:00100000:0.0:1788330365.867024:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792455040:0@lo:400:kworker.0 00000100:00100000:0.0:1788330365.867035:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792455680:0@lo:400:kworker.0 00010000:00080000:0.0:1788330365.867052:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7e74700 x1875199792456320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330365.867062:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792456320:0@lo:400:kworker.0 00000100:00080000:0.0:1788330365.868302:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788330365.868312:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330365.868331:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788330365.885539:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875199792455424:12345-0@lo:8:kworker.0 Request processed in 25058us (26423us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788330365.885562:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788330365.885661:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eeffd69f80 x1875199792455552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330365.885680:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792455552:0@lo:400:kworker.0 00010000:00080000:1.0:1788330365.885697:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7e76a00 x1875199792456192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330365.885705:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792456192:0@lo:400:kworker.0 00000100:00100000:1.0:1788330365.885731:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792455296:0@lo:400:kworker.0 00010000:00080000:1.0:1788330365.885745:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7e75500 x1875199792456064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330365.885877:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792456064:0@lo:400:kworker.0 00000100:00080000:2.0:1788330365.886245:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eee721f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788330365.886261:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788330365.886266:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792455424:0@lo:8:kworker.0 00010000:00010000:3.0:1788330366.563900:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330366.884263:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792456576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788330366.884349:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330366.895614:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792456576 00000100:00100000:2.0:1788330366.895631:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792456576 00000100:00100000:2.0:1788330366.895703:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788330366.895725:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792456576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788330366.895752:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788330366.895843:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792456576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (11495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330366.895851:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788330366.896012:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792456576:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788330367.003965:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788330367.582356:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330367.904687:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330367.904726:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792456704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330367.904817:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330367.913994:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792456832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330367.914070:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330367.914133:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792456704 00000100:00100000:1.0:1788330367.914142:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792456704 00000100:00100000:1.0:1788330367.914205:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792456832 00000100:00100000:1.0:1788330367.914208:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792456832 00000100:00100000:1.0:1788330367.914225:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788330367.914234:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792456704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788330367.914294:0:17108:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788330367.914347:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792456704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (9530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330367.914355:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788330367.914373:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788330367.914380:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792456832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788330367.914399:0:17108:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788330367.914430:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792456832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330367.914437:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788330367.914483:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792456704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330367.914535:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792456832:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788330368.603311:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330369.629816:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330370.654942:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788330370.971419:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330370.971427:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788330370.971432:0:36:0:(import.c:65:import_set_state_nolock()) ffff99eee721f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788330370.971443:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 569 00000100:00080000:0.0:1788330370.971448:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788330370.971456:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99eee721f000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:0.0:1788330370.971486:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc7798700 x1875199792457344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788330370.971527:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330370.971531:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788330370.971533:0:36:0:(import.c:65:import_set_state_nolock()) ffff99edc7e25800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788330370.971536:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 569 00000100:00080000:0.0:1788330370.971538:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788330370.971542:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99edc7e25800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:0.0:1788330370.971553:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc779bb80 x1875199792457856/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788330370.971604:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792457088:0@lo:400:kworker.0 00000100:00100000:1.0:1788330370.971807:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792457472:0@lo:400:kworker.0 00000100:00100000:1.0:1788330370.971870:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330370.971935:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792458112:0@lo:400:kworker.0 00000100:00100000:1.0:1788330370.971959:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330370.971995:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788330370.972001:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792456960:0@lo:400:kworker.0 00000100:00100000:1.0:1788330370.972033:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330370.972055:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792457600:0@lo:400:kworker.0 00000100:00100000:1.0:1788330370.972080:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330370.972098:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792458240:0@lo:400:kworker.0 00000100:00100000:1.0:1788330370.972121:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330370.972185:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792457472 00000100:00100000:1.0:1788330370.972195:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792457472 00000100:00100000:1.0:1788330370.972245:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792458112 00000100:00100000:1.0:1788330370.972249:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792458112 00000100:00100000:1.0:1788330370.972275:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792458240 00000100:00100000:1.0:1788330370.972278:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792458240 00000100:00100000:1.0:1788330370.972297:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788330370.972308:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792457472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330370.972373:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792457472:12345-0@lo:400:kworker.0 Request processed in 66us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330370.972381:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788330370.972399:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788330370.972405:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792458112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330370.972432:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792458112:12345-0@lo:400:kworker.0 Request processed in 28us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330370.972437:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788330370.972448:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788330370.972454:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792458240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330370.972482:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792458240:12345-0@lo:400:kworker.0 Request processed in 29us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330370.972488:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788330370.972508:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792456960 00000100:00100000:1.0:1788330370.972511:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792456960 00000100:00100000:1.0:1788330370.972540:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788330370.972547:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec909fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:3646:x1875199792456960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330370.972576:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec909fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:3646:x1875199792456960:12345-0@lo:400:kworker.0 Request processed in 29us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330370.972592:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788330370.972623:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792457600 00000100:00100000:1.0:1788330370.972627:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792457600 00000100:00100000:1.0:1788330370.972652:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788330370.972658:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792457600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330370.976084:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330370.977108:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792457728:0@lo:400:kworker.0 00000100:00100000:0.0:1788330370.977208:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330370.977247:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788330370.977255:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792457216:0@lo:400:kworker.0 00000100:00100000:0.0:1788330370.977285:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330370.977305:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792457984:0@lo:400:kworker.0 00000100:00100000:0.0:1788330370.977332:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330370.977376:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792457344:0@lo:8:kworker.0 00000100:00100000:0.0:1788330370.977407:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330370.977426:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792457856:0@lo:8:kworker.0 00000100:00100000:0.0:1788330370.977452:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330370.977491:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792457984 00000100:00100000:0.0:1788330370.977502:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792457984 00000100:00100000:0.0:1788330370.977562:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788330370.977573:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792457984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330370.977641:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792457984:12345-0@lo:400:kworker.0 Request processed in 70us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330370.977648:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788330370.977700:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788330370.977707:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330370.977767:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792457728 00000100:00100000:0.0:1788330370.977771:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792457728 00000100:00100000:0.0:1788330370.977800:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792457216 00000100:00100000:0.0:1788330370.977803:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792457216 00000100:00100000:0.0:1788330370.977816:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792457344 00000100:00100000:0.0:1788330370.977819:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792457344 00000100:00100000:1.0:1788330370.977825:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792457600:12345-0@lo:400:kworker.0 Request processed in 5164us (5742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330370.977837:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792457856 00000100:00100000:0.0:1788330370.977840:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792457856 00000100:00100000:0.0:1788330370.977849:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788330370.977855:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792457728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330370.977902:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792457728:12345-0@lo:400:kworker.0 Request processed in 47us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330370.977908:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788330370.977911:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788330370.977929:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792457088 00000100:00100000:1.0:1788330370.977934:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792457088 00000100:00100000:0.0:1788330370.978613:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788330370.978628:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792457216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330370.978687:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792457216:12345-0@lo:400:kworker.0 Request processed in 65us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330370.978694:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788330370.978714:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788330370.978718:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3645:x1875199792457344:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788330370.978744:0:18802:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788330370.978783:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3645:x1875199792457344:12345-0@lo:8:kworker.0 Request processed in 63us (1375us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788330370.978789:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788330370.978800:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788330370.978805:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3645:x1875199792457856:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788330370.978814:0:18802:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788330370.978837:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3645:x1875199792457856:12345-0@lo:8:kworker.0 Request processed in 31us (1385us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788330370.978843:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788330370.978883:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330370.978899:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792458368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330370.979250:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788330370.979289:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788330370.979327:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eee721f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788330370.979333:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788330370.979338:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792457344:0@lo:8:kworker.0 00000100:00080000:0.0:1788330370.979348:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7e25800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788330370.979352:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788330370.979355:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792457856:0@lo:8:kworker.0 00000100:00100000:0.0:1788330370.979384:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792458368 00000100:00100000:0.0:1788330370.979389:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792458368 00000100:00100000:0.0:1788330370.979423:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788330370.979431:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792458368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788330370.979641:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788330370.979700:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792458368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 269us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330370.979707:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788330370.979751:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792458368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330370.979784:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792457216:0@lo:400:kworker.0 00010000:00080000:0.0:1788330370.979801:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7798a80 x1875199792457984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330370.979812:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792457984:0@lo:400:kworker.0 00000100:00100000:0.0:1788330370.979824:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792457728:0@lo:400:kworker.0 00000100:00100000:0.0:1788330370.980118:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792456960:0@lo:400:kworker.0 00000100:00100000:0.0:1788330370.980182:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792457600:0@lo:400:kworker.0 00010000:00080000:0.0:1788330370.980200:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eeffd68a80 x1875199792458240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330370.980210:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792458240:0@lo:400:kworker.0 00010000:00080000:0.0:1788330370.980223:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc7799c00 x1875199792457472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330370.980231:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792457472:0@lo:400:kworker.0 00010000:00080000:0.0:1788330370.980244:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc779a300 x1875199792458112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330370.980253:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792458112:0@lo:400:kworker.0 00000100:00100000:3.0:1788330370.982869:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788330370.982895:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792457088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330370.983217:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792457088:12345-0@lo:400:kworker.0 Request processed in 332us (7142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330370.983226:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788330370.983305:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792457088:0@lo:400:kworker.0 00000020:01000004:3.0:1788330371.094559:0:19425:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788330371.094564:0:19425:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788330371.094566:0:19425:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788330371.094774:0:19425:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99edc7f1d000 00000020:01000004:3.0:1788330371.094797:0:19425:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788330371.094820:0:19425:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788330371.094842:0:19425:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99eee764b370) 00000020:00000080:3.0:1788330371.094866:0:19425:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788330371.153984:0:19425:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788330371.156912:0:19425:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788330371.157169:0:19425:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788330371.157565:0:19425:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788330371.157786:0:19425:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788330371.158025:0:19425:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788330371.158270:0:19425:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1788330371.159882:0:19425:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788330371.160291:0:19425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788330371.160314:0:19425:0:(osd_handler.c:8927:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788330371.160334:0:19425:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8475908e9fd2365 00000020:01000004:2.0:1788330371.160344:0:19425:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788330371.160372:0:19425:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.150@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788330371.160377:0:19425:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788330371.160385:0:19425:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788330371.160421:0:19425:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788330371.160427:0:19425:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788330371.191542:0:19425:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788330371.191602:0:19425:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.150@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788330371.191608:0:19425:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788330371.191610:0:19425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788330371.191612:0:19425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330371.191613:0:19425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330371.191614:0:19425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330371.191616:0:19425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330371.191618:0:19425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788330371.191620:0:19425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330371.191621:0:19425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788330371.191626:0:19425:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788330371.191628:0:19425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788330371.191630:0:19425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788330371.191631:0:19425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330371.191632:0:19425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330371.191633:0:19425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330371.191634:0:19425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330371.191635:0:19425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788330371.191636:0:19425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330371.191637:0:19425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788330371.191686:0:19425:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788330371.191724:0:19425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792458496:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788330371.191824:0:19425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330371.191899:0:19425:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeded4b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330371.192325:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792458496 00000100:00100000:0.0:1788330371.192335:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792458496 00000100:00100000:0.0:1788330371.192409:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788330371.192423:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec909c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:19425:x1875199792458496:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788330371.192479:0:17098:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788330371.192483:0:17098:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788330371.192488:0:17098:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788330371.193619:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec909c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:19425:x1875199792458496:12345-0@lo:253:mount.lustre.0 Request processed in 1191us (1787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330371.193632:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788330371.193881:0:19425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792458496:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788330371.193899:0:19425:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788330371.193903:0:19425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788330371.193905:0:19425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788330371.193906:0:19425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330371.193907:0:19425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330371.193919:0:19425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330371.193920:0:19425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330371.193922:0:19425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788330371.193924:0:19425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330371.193926:0:19425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788330371.193953:0:19425:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99edc7f1d000 from lustre-OST0001 10000000:01000000:3.0:1788330371.193993:0:19425:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788330371.193997:0:19425:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788330371.194010:0:19425:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99edc67d8000 local copy 00010000:00010000:3.0:1788330371.194024:0:19425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd1fb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1fbb expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330371.194200:0:19425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792458624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330371.194248:0:19425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330371.194291:0:19425:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeded4be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788330371.197051:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792458624 00000100:00100000:0.0:1788330371.197075:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792458624 00000100:00100000:0.0:1788330371.197212:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788330371.197226:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:19425:x1875199792458624:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330371.197443:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:19425:x1875199792458624:12345-0@lo:501:mount.lustre.0 Request processed in 219us (3194us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788330371.197452:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788330371.200357:0:19425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792458624:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788330371.200398:0:19425:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788330371.200454:0:19425:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788330371.200465:0:19425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd1fb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1fbb expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.200478:0:19425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec9038a00/0x8475908e9fd1fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd1fbb expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330371.200533:0:19425:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99edc7f1d000 10000000:01000000:3.0:1788330371.200540:0:19425:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788330371.200547:0:19425:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788330371.200550:0:19425:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788330371.200556:0:19425:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788330371.200559:0:19425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788330371.200602:0:19425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd236c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.200624:0:19425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd236c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.200637:0:19425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd236c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330371.200662:0:19425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792458752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788330371.200761:0:19425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330371.200807:0:19425:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeded4be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788330371.201028:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792458752 00000100:00100000:0.0:1788330371.201038:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792458752 00000100:00100000:0.0:1788330371.201115:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788330371.201127:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec909ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:19425:x1875199792458752:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330371.201183:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330371.201202:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec1327e00/0x8475908e9fd2373 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd236c expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.201235:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec1327e00/0x8475908e9fd2373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd236c expref: 22 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.201248:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec1327e00/0x8475908e9fd2373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd236c expref: 22 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.201259:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327e00, rc 0) 00000100:00100000:0.0:1788330371.201322:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec909ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:19425:x1875199792458752:12345-0@lo:101:mount.lustre.0 Request processed in 196us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330371.201329:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788330371.202329:0:19425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792458752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330371.202355:0:19425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd236c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2373 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.202369:0:19425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd236c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2373 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788330371.204832:0:19425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788330371.205811:0:19425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788330371.208584:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788330371.208656:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788330371.208688:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788330371.217622:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788330371.218477:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788330371.218508:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788330371.218544:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788330371.218551:0:19425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788330371.218950:0:19425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7695f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792458880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330371.219049:0:19425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330371.219400:0:19425:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee733e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788330371.229529:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792458880 00000100:00100000:1.0:1788330371.229554:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792458880 00000100:00100000:1.0:1788330371.230952:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788330371.230975:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:19425:x1875199792458880:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330371.231357:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:19425:x1875199792458880:12345-0@lo:501:mount.lustre.0 Request processed in 387us (12306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330371.231367:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788330371.231737:0:19425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7695f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792458880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330371.231813:0:19425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7695f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792459008:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788330371.231887:0:19425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330371.231941:0:19425:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee733e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788330371.232074:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792459008 00000100:00100000:3.0:1788330371.232084:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792459008 00000100:00100000:3.0:1788330371.232147:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788330371.232191:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:19425:x1875199792459008:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788330371.233183:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:19425:x1875199792459008:12345-0@lo:503:mount.lustre.0 Request processed in 962us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330371.233205:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788330371.237905:0:19425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7695f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792459008:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788330371.238691:0:19425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788330371.239830:0:19425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7695f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792459136:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330371.239965:0:19425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330371.240035:0:19425:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec920cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330371.241508:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792459136 00000100:00100000:3.0:1788330371.241531:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792459136 00000100:00100000:3.0:1788330371.241617:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788330371.241631:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:19425:x1875199792459136:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330371.243239:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:19425:x1875199792459136:12345-0@lo:502:mount.lustre.0 Request processed in 1597us (3262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330371.243257:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788330371.243587:0:19425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7695f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792459136:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788330371.246298:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788330371.246376:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788330371.246393:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788330371.246406:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788330371.246422:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788330371.246436:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788330371.246451:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788330371.246465:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788330371.246477:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788330371.246554:0:19425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7695f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792459264:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330371.246687:0:19425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330371.246744:0:19425:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec920cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788330371.247039:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792459264 00000100:00100000:1.0:1788330371.247050:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792459264 00000100:00100000:1.0:1788330371.247129:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788330371.247142:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:19425:x1875199792459264:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330371.248642:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:19425:x1875199792459264:12345-0@lo:502:mount.lustre.0 Request processed in 1492us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330371.248656:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788330371.249784:0:19425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7695f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792459264:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788330371.249932:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788330371.249954:0:19425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788330371.252232:0:19429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788330371.252252:0:19429:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788330371.252500:0:19429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330371.252504:0:19429:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788330371.252519:0:19429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788330371.252545:0:19429:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99eefd3319b8) 00000020:00000080:1.0:1788330371.252588:0:19429:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788330371.252596:0:19429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788330371.252786:0:19429:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99edc7f1d000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788330371.252799:0:19429:0:(osd_handler.c:8927:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788330371.252809:0:19429:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8475908e9fd2381 00010000:00010000:0.0:1788330371.268381:0:19429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1788330371.269992:0:19429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967326 00080000:10000000:2.0:1788330371.276282:0:19429:0:(osd_handler.c:5583:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788330371.289465:0:19429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788330371.289487:0:19429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330371.289498:0:19429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330371.289500:0:19429:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788330371.289506:0:19429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330371.289510:0:19429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330371.289512:0:19429:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788330371.289516:0:19429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788330371.289518:0:19429:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788330371.289521:0:19429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330371.289523:0:19429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330371.289525:0:19429:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788330371.289528:0:19429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330371.289530:0:19429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330371.289532:0:19429:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788330371.289536:0:19429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788330371.289581:0:19429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330371.289583:0:19429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330371.289585:0:19429:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788330371.289589:0:19429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788330371.290640:0:19425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788330371.291097:0:19425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788330371.291142:0:19425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd236c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2373 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.291202:0:19425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eeef91a200/0x8475908e9fd236c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2373 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330371.292718:0:19425:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99edc7f1d000 from 1 10000000:01000000:1.0:1788330371.292732:0:19425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788330371.292799:0:19425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7eea00/0x8475908e9fd2388 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330371.292814:0:19425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eefe7eea00/0x8475908e9fd2388 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330371.292830:0:19425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eefe7eea00/0x8475908e9fd2388 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330371.292865:0:19425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792459392:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788330371.292974:0:19425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330371.293035:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792459392 00000100:00100000:1.0:1788330371.293045:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792459392 00000100:00100000:1.0:1788330371.293182:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788330371.293194:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:19425:x1875199792459392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330371.293214:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330371.293231:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eefe7ee800/0x8475908e9fd238f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2388 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330371.293266:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eefe7ee800/0x8475908e9fd238f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2388 expref: 23 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330371.293515:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eefe7ee800/0x8475908e9fd238f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2388 expref: 23 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330371.293526:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eefe7ee800, rc 0) 00000100:00100000:1.0:1788330371.293579:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:19425:x1875199792459392:12345-0@lo:101:mount.lustre.0 Request processed in 387us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330371.293586:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788330371.293648:0:19425:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7263e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788330371.293687:0:19425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792459392:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330371.294252:0:19425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eefe7eea00/0x8475908e9fd2388 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd238f expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330371.294268:0:19425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eefe7eea00/0x8475908e9fd2388 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd238f expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788330371.298045:0:19425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788330371.298519:0:19425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788330371.298821:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788330371.298849:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788330371.298869:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788330371.298875:0:19425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788330371.298978:0:19425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792459520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330371.299082:0:19425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330371.299140:0:19425:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee72630c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330371.299841:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792459520 00000100:00100000:2.0:1788330371.299856:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792459520 00000100:00100000:2.0:1788330371.299930:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788330371.299943:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:19425:x1875199792459520:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330371.300143:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:19425:x1875199792459520:12345-0@lo:501:mount.lustre.0 Request processed in 202us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330371.300176:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788330371.300261:0:19425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792459520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330371.300320:0:19425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792459648:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788330371.300373:0:19425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330371.300406:0:19425:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeded4ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788330371.300649:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792459648 00000100:00100000:0.0:1788330371.300656:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792459648 00000100:00100000:0.0:1788330371.300713:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788330371.300723:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:19425:x1875199792459648:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330371.300847:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:19425:x1875199792459648:12345-0@lo:503:mount.lustre.0 Request processed in 126us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330371.300855:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788330371.301122:0:19425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792459648:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788330371.301687:0:19425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788330371.301792:0:19425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792459776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330371.301858:0:19425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330371.301901:0:19425:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeded4ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330371.301901:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792459776 00000100:00100000:2.0:1788330371.301908:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792459776 00000100:00100000:2.0:1788330371.301954:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788330371.301963:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:19425:x1875199792459776:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330371.302084:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:19425:x1875199792459776:12345-0@lo:502:mount.lustre.0 Request processed in 122us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330371.302091:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788330371.303123:0:19425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792459776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788330371.303416:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788330371.303448:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788330371.303460:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788330371.303471:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788330371.303481:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788330371.305627:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788330371.305701:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788330371.305731:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788330371.305746:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788330371.305760:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788330371.305774:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788330371.306713:0:19425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792459904:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330371.307045:0:19425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330371.307198:0:19425:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeded4ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330371.311359:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792459904 00000100:00100000:2.0:1788330371.311384:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792459904 00000100:00100000:3.0:1788330371.312526:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788330371.312544:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:19425:x1875199792459904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330371.312838:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:19425:x1875199792459904:12345-0@lo:502:mount.lustre.0 Request processed in 297us (5792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330371.312848:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788330371.313236:0:19425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792459904:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788330371.313365:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788330371.313384:0:19425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788330371.314371:0:19433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330371.314385:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330371.314388:0:19433:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788330371.314396:0:19433:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99edc7f1d000 00000020:00000080:2.0:1788330371.314399:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788330371.314409:0:19433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330371.314411:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330371.314413:0:19433:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788330371.314415:0:19433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330371.314418:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330371.314419:0:19433:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788330371.314422:0:19433:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99edc7f1d000 00000020:00000080:2.0:1788330371.314425:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788330371.314492:0:19433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330371.314495:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330371.314497:0:19433:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788330371.314499:0:19433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330371.314502:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330371.314503:0:19433:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788330371.314507:0:19433:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99edc7f1d000 00000020:00000080:2.0:1788330371.314509:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788330371.314526:0:19433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330371.314528:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330371.314529:0:19433:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788330371.314532:0:19433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330371.314535:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330371.314536:0:19433:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788330371.314549:0:19433:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99edc7f1d000 00000020:00000080:2.0:1788330371.314551:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788330371.314575:0:19433:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330371.314578:0:19433:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330371.314580:0:19433:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788330371.314583:0:19433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1788330371.314858:0:19425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788330371.314888:0:19425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788330371.314919:0:19425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7eea00/0x8475908e9fd2388 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd238f expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.314933:0:19425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eefe7eea00/0x8475908e9fd2388 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd238f expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330371.314995:0:19425:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788330371.314999:0:19425:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99edc7f1d000 10000000:01000000:0.0:1788330371.315003:0:19425:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99edc7f1d000 10000000:01000000:0.0:1788330371.315007:0:19425:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788330371.315013:0:19425:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99edc7f1d000 from 1 10000000:01000000:0.0:1788330371.315023:0:19425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788330371.315075:0:19425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1326000/0x8475908e9fd2396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.315084:0:19425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec1326000/0x8475908e9fd2396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.315096:0:19425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec1326000/0x8475908e9fd2396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330371.315142:0:19425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792460032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788330371.315258:0:19425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330371.315481:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792460032 00000100:00100000:0.0:1788330371.315491:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792460032 00000100:00100000:0.0:1788330371.315543:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788330371.315553:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:19425:x1875199792460032:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330371.315568:0:17095:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330371.315583:0:17095:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec1326800/0x8475908e9fd239d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2396 expref: -99 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.315607:0:17095:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec1326800/0x8475908e9fd239d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2396 expref: 24 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.315617:0:17095:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec1326800/0x8475908e9fd239d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2396 expref: 24 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.315628:0:17095:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1326800, rc 0) 00000100:00100000:0.0:1788330371.315663:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:19425:x1875199792460032:12345-0@lo:101:mount.lustre.0 Request processed in 111us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330371.315683:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788330371.315883:0:19425:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eef4118000 going to sleep for 11 seconds 00000100:00100000:0.0:1788330371.315909:0:19425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792460032:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330371.315927:0:19425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec1326000/0x8475908e9fd2396 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd239d expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.315938:0:19425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec1326000/0x8475908e9fd2396 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd239d expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788330371.321536:0:19425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1788330371.321960:0:19425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788330371.322616:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788330371.322651:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788330371.322678:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788330371.322693:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788330371.322708:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788330371.322737:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788330371.322753:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788330371.322766:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788330371.322778:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788330371.322791:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788330371.322804:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788330371.322818:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788330371.322829:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788330371.322844:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788330371.322856:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788330371.322870:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788330371.322882:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788330371.322895:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788330371.322907:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788330371.322921:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788330371.322934:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788330371.325529:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788330371.325792:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788330371.325819:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788330371.325847:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788330371.325884:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788330371.325899:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788330371.325911:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788330371.325925:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788330371.325938:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788330371.325952:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788330371.325966:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788330371.325980:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788330371.325994:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788330371.326007:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788330371.326022:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788330371.326036:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788330371.326049:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788330371.326062:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1788330371.326074:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1788330371.326087:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1788330371.326113:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1788330371.326129:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1788330371.326199:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1788330371.326217:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1788330371.326231:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1788330371.326268:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1788330371.326275:0:19425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1788330371.326445:0:19425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792460160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330371.326538:0:19425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330371.326601:0:19425:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7263f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788330371.326718:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792460160 00000100:00100000:0.0:1788330371.326729:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792460160 00000100:00100000:0.0:1788330371.326801:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788330371.326814:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:19425:x1875199792460160:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330371.326983:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:19425:x1875199792460160:12345-0@lo:501:mount.lustre.0 Request processed in 170us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330371.326993:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788330371.327566:0:19425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792460160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330371.327619:0:19425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792460288:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788330371.327690:0:19425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330371.327833:0:19425:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7263f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788330371.328240:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792460288 00000100:00100000:0.0:1788330371.328248:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792460288 00000100:00100000:1.0:1788330371.328812:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788330371.328827:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7790450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:19425:x1875199792460288:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788330371.328980:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7790450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:19425:x1875199792460288:12345-0@lo:503:mount.lustre.0 Request processed in 157us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330371.328989:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788330371.329065:0:19425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792460288:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788330371.336244:0:19425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788330371.336389:0:19425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792460416:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788330371.336499:0:19425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330371.336556:0:19425:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7263f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788330371.345451:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792460416 00000100:00100000:0.0:1788330371.345481:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792460416 00000100:00100000:0.0:1788330371.345573:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788330371.345586:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:19425:x1875199792460416:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330371.345969:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:19425:x1875199792460416:12345-0@lo:502:mount.lustre.0 Request processed in 384us (9468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330371.345979:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788330371.346108:0:19425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792460416:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788330371.346488:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788330371.346531:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788330371.346562:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788330371.346579:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788330371.346594:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788330371.346607:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788330371.346621:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788330371.346635:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788330371.346648:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788330371.346661:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788330371.346692:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788330371.346955:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788330371.346976:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788330371.346991:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788330371.347005:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788330371.347018:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788330371.347033:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788330371.347057:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788330371.347086:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788330371.347103:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788330371.347116:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788330371.347148:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788330371.347196:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788330371.347212:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788330371.347225:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1788330371.347239:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1788330371.347252:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1788330371.347265:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1788330371.347356:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1788330371.347373:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1788330371.347387:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1788330371.347400:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1788330371.347414:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1788330371.347430:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1788330371.347457:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1788330371.347474:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1788330371.347488:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1788330371.347503:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1788330371.347517:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1788330371.347531:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1788330371.347546:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1788330371.347561:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1788330371.347575:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1788330371.347588:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1788330371.347602:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1788330371.347615:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1788330371.347630:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1788330371.347644:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1788330371.347961:0:19425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792460544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788330371.348063:0:19425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330371.349335:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792460544 00000100:00100000:0.0:1788330371.349351:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792460544 00000100:00100000:0.0:1788330371.349429:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788330371.349443:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:19425:x1875199792460544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330371.349639:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:19425:x1875199792460544:12345-0@lo:502:mount.lustre.0 Request processed in 198us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330371.349648:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788330371.349903:0:19425:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7263f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788330371.349965:0:19425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792460544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788330371.350915:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1788330371.350981:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1788330371.351037:0:19425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792460672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788330371.351129:0:19425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330371.351190:0:19425:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7263f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788330371.352376:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792460672 00000100:00100000:0.0:1788330371.352396:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792460672 00000100:00100000:0.0:1788330371.352461:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788330371.352472:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:19425:x1875199792460672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330371.352685:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:19425:x1875199792460672:12345-0@lo:502:mount.lustre.0 Request processed in 213us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330371.352694:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788330371.356931:0:19425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792460672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788330371.357074:0:19425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1788330371.357094:0:19425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788330371.360686:0:19438:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788330371.360792:0:19438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99eefd330000) 00000020:00000080:1.0:1788330371.360828:0:19438:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788330371.360930:0:19438:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99edc7f1d000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788330371.360935:0:19438:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99edc7f1d000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788330371.360939:0:19438:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99edc7f1d000 3 00010000:00080000:1.0:1788330371.360983:0:19438:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99eedef8b000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.150@tcp at head 00010000:00010000:1.0:1788330371.365033:0:19438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788330371.365982:0:19438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788330371.366043:0:19438:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788330371.366061:0:19438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8475908e9fd23ab 00000100:00080000:1.0:1788330371.366076:0:19438:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788330371.366084:0:19438:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99eedef8b000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330371.366397:0:19438:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eeffcfa300 x1875199792460800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788330371.366475:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875199792460800:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788330371.366588:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788330371.366678:0:19438:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788330371.366723:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792460800 00000100:00100000:0.0:1788330371.366735:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792460800 00000100:00080000:1.0:1788330371.366782:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788330371.366782:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788330371.366787:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788330371.366789:0:36:0:(import.c:65:import_set_state_nolock()) ffff99eee721f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330371.366794:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 574 00000100:00100000:0.0:1788330371.366796:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875199792460800:12345-0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788330371.366797:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788330371.366801:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99eee721f000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330371.366816:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eeffcfb800 x1875199792461184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:0.0:1788330371.366829:0:17103:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 575 last 0 00000100:00100000:3.0:1788330371.368070:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00000080:0.0:1788330371.368271:0:17103:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8475908e9fd23b2 00000004:00100000:0.0:1788330371.368295:0:17103:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788330371.368346:0:17103:0:(import.c:65:import_set_state_nolock()) ffff99edc7e21000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788330371.368466:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792460928:0@lo:400:kworker.0 00000100:00100000:3.0:1788330371.368517:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330371.368568:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788330371.368580:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792461056:0@lo:400:kworker.0 00000100:00100000:3.0:1788330371.368611:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330371.368651:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792460928 00000100:00100000:3.0:1788330371.368659:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792460928 00000100:00100000:3.0:1788330371.368733:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788330371.368744:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792460928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330371.368799:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792460928:12345-0@lo:400:kworker.0 Request processed in 55us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330371.368808:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788330371.368850:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792461056 00000100:00100000:3.0:1788330371.368853:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792461056 00000100:00100000:3.0:1788330371.369448:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788330371.369457:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792461056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330371.369513:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792461056:12345-0@lo:400:kworker.0 Request processed in 57us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330371.369520:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788330371.369589:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792460928:0@lo:400:kworker.0 00000100:00100000:2.0:1788330371.369601:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792461184:0@lo:8:kworker.0 00000100:00100000:3.0:1788330371.369630:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792461056:0@lo:400:kworker.0 00000100:00100000:2.0:1788330371.369643:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788330371.373065:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330371.373074:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788330371.373079:0:36:0:(import.c:65:import_set_state_nolock()) ffff99edc7e25800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330371.373089:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 574 00000100:00080000:1.0:1788330371.373096:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788330371.373104:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99edc7e25800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330371.373133:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99eeffcf9180 x1875199792461696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788330371.373234:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792461568:0@lo:400:kworker.0 00000100:00100000:0.0:1788330371.373821:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875199792460800:12345-0@lo:38:llog_process_th.0 Request processed in 7019us (7227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330371.373957:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788330371.374024:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792461184 00000100:00100000:0.0:1788330371.374033:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792461184 00000100:00100000:0.0:1788330371.374071:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788330371.374081:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875199792461184:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788330371.374280:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875199792461184:12345-0@lo:8:kworker.0 Request processed in 198us (4635us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788330371.374288:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788330371.374448:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330371.374491:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788330371.374502:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792461440:0@lo:400:kworker.0 00000100:00100000:1.0:1788330371.374535:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330371.374554:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792462080:0@lo:400:kworker.0 00000100:00100000:1.0:1788330371.374576:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330371.374602:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792461824:0@lo:400:kworker.0 00000100:00100000:1.0:1788330371.374663:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330371.374711:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788330371.374718:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792461312:0@lo:400:kworker.0 00000100:00100000:1.0:1788330371.374742:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330371.374762:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792461952:0@lo:400:kworker.0 00000100:00100000:1.0:1788330371.374783:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330371.374819:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792461568 00000100:00100000:1.0:1788330371.374824:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792461568 00000100:00100000:1.0:1788330371.374867:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788330371.374875:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8453b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792461568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330371.374929:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8453b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792461568:12345-0@lo:400:kworker.0 Request processed in 55us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330371.374935:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788330371.374959:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792461440 00000100:00100000:1.0:1788330371.374963:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792461440 00000100:00100000:1.0:1788330371.374992:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788330371.374999:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792461440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330371.375036:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792461440:12345-0@lo:400:kworker.0 Request processed in 38us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330371.375042:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788330371.375059:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792462080 00000100:00100000:1.0:1788330371.375063:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792462080 00000100:00100000:1.0:1788330371.375080:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792461824 00000100:00100000:1.0:1788330371.375083:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792461824 00000100:00100000:1.0:1788330371.375094:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792461312 00000100:00100000:1.0:1788330371.375096:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792461312 00000100:00100000:1.0:1788330371.375107:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792461952 00000100:00100000:1.0:1788330371.375109:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792461952 00000100:00100000:1.0:1788330371.375133:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788330371.375139:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792462080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330371.375213:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792462080:12345-0@lo:400:kworker.0 Request processed in 73us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330371.375220:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788330371.375231:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788330371.375237:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792461824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330371.375268:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875199792461824:12345-0@lo:400:kworker.0 Request processed in 31us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330371.376049:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788330371.376064:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792461312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330371.376094:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788330371.376114:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788330371.376121:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792461952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330371.376188:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792461952:12345-0@lo:400:kworker.0 Request processed in 68us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330371.376197:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788330371.376263:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc8450e00 x1875199792461952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330371.376494:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792461952:0@lo:400:kworker.0 00010000:00080000:1.0:1788330371.376510:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc8453480 x1875199792461824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330371.376518:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875199792461824:0@lo:400:kworker.0 00000100:00100000:1.0:1788330371.376557:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792461440:0@lo:400:kworker.0 00010000:00080000:1.0:1788330371.376568:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc8453800 x1875199792462080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330371.376588:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792462080:0@lo:400:kworker.0 00000100:00100000:1.0:1788330371.376604:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792461568:0@lo:400:kworker.0 00000100:00100000:0.0:1788330371.377276:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875199792461312:12345-0@lo:400:kworker.0 Request processed in 1210us (2525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330371.377288:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788330371.378001:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eeffcfa300 x1875199792460800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788330381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330371.378016:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788330371.378027:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788330371.378038:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788330371.378044:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788330371.378049:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eedef8b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788330371.378057:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875199792460800:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788330371.378922:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99eeffcfbb80 x1875199792461312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330371.378939:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875199792461312:0@lo:400:kworker.0 00000100:00100000:2.0:1788330371.383912:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792461696:0@lo:8:kworker.0 00000100:00100000:2.0:1788330371.384027:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330371.384107:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788330371.384131:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eee721f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788330371.384137:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788330371.384142:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792461184:0@lo:8:kworker.0 00000100:00100000:0.0:1788330371.384258:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792461696 00000100:00100000:0.0:1788330371.384269:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792461696 00000100:00100000:0.0:1788330371.384356:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788330371.384368:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1875199792461696:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788330371.384452:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1875199792461696:12345-0@lo:8:kworker.0 Request processed in 85us (426us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788330371.384461:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788330371.384835:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788330371.384841:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7e25800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788330371.384856:0:3645:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788330371.384860:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792461696:0@lo:8:kworker.0 00000020:01000004:1.0:1788330371.387557:0:19438:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788330371.387583:0:19438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff99eefd334d28) 00000020:00000080:1.0:1788330371.387618:0:19438:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788330371.389808:0:19438:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99edc7f1d000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788330371.389821:0:19438:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99edc7f1d000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788330371.389825:0:19438:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99edc7f1d000 3 00010000:00080000:1.0:1788330371.389898:0:19438:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99edc5da7000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.150@tcp at head 00010000:00010000:1.0:1788330371.395659:0:19438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788330371.395926:0:19438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788330371.395983:0:19438:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788330371.396001:0:19438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x8475908e9fd23c0 00000100:00080000:1.0:1788330371.396015:0:19438:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788330371.396024:0:19438:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99edc5da7000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330371.396077:0:19438:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc8453800 x1875199792462208/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788330371.397495:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875199792462208:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788330371.397605:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330371.397798:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792462208 00000100:00100000:0.0:1788330371.397808:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792462208 00000100:00100000:0.0:1788330371.397880:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788330371.397890:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875199792462208:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788330371.397930:0:18635:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 575 last 0 00000020:00000080:0.0:1788330371.397996:0:18635:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x8475908e9fd23c7 00000004:00100000:0.0:1788330371.398019:0:18635:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788330371.398063:0:18635:0:(import.c:65:import_set_state_nolock()) ffff99edc7e26800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788330371.398846:0:19438:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788330371.404035:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875199792462208:12345-0@lo:38:llog_process_th.0 Request processed in 6128us (6412us total) trans 0 rc 0/0 00010000:00080000:2.0:1788330371.404040:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99edc8453800 x1875199792462208/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788330381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330371.404054:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788330371.404055:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788330371.404069:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788330371.404082:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788330371.404088:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788330371.404093:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc5da7000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788330371.404103:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875199792462208:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788330371.407976:0:19438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788330371.408057:0:19425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788330371.408097:0:19425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788330371.408815:0:19425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec1326000/0x8475908e9fd2396 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd239d expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330371.408847:0:19425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec1326000/0x8475908e9fd2396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd239d expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788330371.408926:0:19425:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788330371.408929:0:19425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788330371.408931:0:19425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330371.408932:0:19425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330371.408934:0:19425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330371.408935:0:19425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330371.408937:0:19425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788330371.408940:0:19425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330371.408941:0:19425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788330371.408947:0:19425:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788330371.408951:0:19425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788330371.408952:0:19425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788330371.408953:0:19425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330371.408955:0:19425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330371.408956:0:19425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330371.408957:0:19425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330371.408958:0:19425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788330371.408959:0:19425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330371.408960:0:19425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788330371.409002:0:19425:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788330371.409033:0:19425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792462336:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788330371.409365:0:19425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330371.409410:0:19425:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee7263e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788330371.411886:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792462336 00000100:00100000:0.0:1788330371.411908:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792462336 00000100:00100000:0.0:1788330371.411986:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788330371.412000:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc661f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:19425:x1875199792462336:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788330371.412052:0:17098:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788330371.412072:0:17098:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788330371.418034:0:17098:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788330371.418064:0:17098:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788330371.418214:0:17119:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788330371.418221:0:17119:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788330371.418253:0:17119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99eeef91a800/0x8475908e9fd23ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.418278:0:17119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2270 expref: 24 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.418287:0:17119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eefe7ee200/0x8475908e9fd2285 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd227e expref: 24 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.418296:0:17119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99eeef91a800/0x8475908e9fd23ce lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.418351:0:17119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eefe7ee200/0x8475908e9fd2285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd227e expref: 24 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.418368:0:17119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eefe7ee200/0x8475908e9fd2285 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd227e expref: 24 pid: 17095 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330371.418388:0:17119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e75500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1875199792462464:0@lo:104: 00000100:00100000:3.0:1788330371.418481:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788330371.418558:0:17119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd2270 expref: 24 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.418567:0:17119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2277 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd2270 expref: 24 pid: 17097 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330371.418576:0:17119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e74700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1875199792462592:0@lo:104: 00000100:00100000:3.0:1788330371.418599:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330371.418626:0:17119:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788330371.418652:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792462464 00000100:00100000:1.0:1788330371.418652:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc661f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:19425:x1875199792462336:12345-0@lo:253:mount.lustre.0 Request processed in 6654us (9287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330371.418660:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792462464 00000100:00100000:1.0:1788330371.418676:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788330371.418713:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792462592 00000100:00100000:3.0:1788330371.418716:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792462592 00000100:00100000:3.0:1788330371.418731:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788330371.418740:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+4:17119:x1875199792462464:12345-0@lo:104: 00010000:00010000:3.0:1788330371.418756:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eefe7efc00/0x8475908e9fd227e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2285 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330371.418757:0:19425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:19425:1875199792462336:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788330371.418771:0:19425:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788330371.418776:0:19425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788330371.418784:0:19425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788330371.418786:0:19425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330371.418787:0:19425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330371.418789:0:19425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330371.418790:0:19425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330371.418792:0:19425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788330371.418795:0:19425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330371.418796:0:19425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:3.0:1788330371.418806:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788330371.418811:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+4:17119:x1875199792462464:12345-0@lo:104: Request processed in 73us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330371.418819:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000020:02000000:1.0:1788330371.418819:0:19425:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788330371.418833:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788330371.418837:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+3:17119:x1875199792462592:12345-0@lo:104: 00010000:00010000:3.0:1788330371.418845:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2277 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.418892:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788330371.418897:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+3:17119:x1875199792462592:12345-0@lo:104: Request processed in 60us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330371.418910:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788330371.418935:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330371.418942:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eefe7efc00/0x8475908e9fd227e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2285 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.418950:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7efc00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330371.418955:0:17091:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eefe7efc00/0x8475908e9fd227e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd2285 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.418965:0:17091:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eefe7efc00/0x8475908e9fd227e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd2285 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330371.418974:0:17091:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eefe7efc00/0x8475908e9fd227e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd2285 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330371.418981:0:17091:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788330371.419021:0:17091:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eefe7efc00/0x8475908e9fd227e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2285 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.419028:0:17091:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330371.419057:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eefe7efc00/0x8475908e9fd227e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2285 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.419065:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eefe7efc00/0x8475908e9fd227e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2285 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.419078:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330371.419081:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd2277 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.419727:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039200 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:3.0:1788330371.419732:0:17091:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd2277 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.419742:0:17091:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd2277 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330371.419749:0:17091:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd2277 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330371.419754:0:17091:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788330371.419778:0:17091:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2270 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2277 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.419784:0:17091:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330371.419817:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2270 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2277 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.419823:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec9039200/0x8475908e9fd2270 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd2277 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.419843:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330371.419845:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330371.419847:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330371.420265:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792462848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330371.420417:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330371.420687:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792462848 00000100:00100000:0.0:1788330371.420698:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792462848 00010000:00010000:0.0:1788330371.420736:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2277 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2270 expref: 24 pid: 17097 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330371.420789:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788330371.420799:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7697b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:3646:x1875199792462848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330371.420817:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330371.420823:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2277 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2270 expref: 24 pid: 17097 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330371.421228:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330371.421255:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3649:1875199792462720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330371.421312:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330371.421378:0:17088:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788330371.421388:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788330371.421460:0:17119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e75500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1875199792462464:0@lo:104: 00000100:00100000:3.0:1788330371.421473:0:17119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e74700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17119:1875199792462592:0@lo:104: 00010000:00010000:3.0:1788330371.421500:0:17119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99eeef91a800/0x8475908e9fd23ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.421588:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd2270 expref: 24 pid: 17097 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.421606:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eeef91be00/0x8475908e9fd2277 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd2270 expref: 24 pid: 17097 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.421624:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330371.421685:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7697b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:3646:x1875199792462848:12345-0@lo:103:ldlm_bl.0 Request processed in 888us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330371.421693:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788330371.421716:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792462720 00000100:00100000:0.0:1788330371.421721:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792462720 00010000:00010000:0.0:1788330371.421739:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eefe7ee200/0x8475908e9fd2285 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd227e expref: 23 pid: 17095 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330371.421754:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788330371.421761:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:3649:x1875199792462720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330371.421769:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330371.421773:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eefe7ee200/0x8475908e9fd2285 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd227e expref: 23 pid: 17095 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.421784:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eefe7ee200/0x8475908e9fd2285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd227e expref: 23 pid: 17095 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.421803:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eefe7ee200/0x8475908e9fd2285 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd227e expref: 23 pid: 17095 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.421814:0:17089:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99eeef91a800/0x8475908e9fd23ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.421823:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eeef91a800/0x8475908e9fd23ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788330371.422963:0:17089:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014354416s 00010000:00010000:0.0:1788330371.422980:0:17089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eeef91a800/0x8475908e9fd23ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.422991:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eeef91a800/0x8475908e9fd23ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.422998:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99eeef91a800/0x8475908e9fd23ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.423006:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99eeef91a800/0x8475908e9fd23ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.423013:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91a800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330371.423018:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99eeef91a800/0x8475908e9fd23ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.423026:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99eeef91a800/0x8475908e9fd23ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.423059:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99eeef91a800/0x8475908e9fd23ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330371.423089:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330371.424310:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:3649:x1875199792462720:12345-0@lo:103:ldlm_bl.0 Request processed in 2539us (2988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330371.424327:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788330371.424401:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792462848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330371.424437:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3649:1875199792462720:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330371.428964:0:17119:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99eeef91a800/0x8475908e9fd23ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330371.428990:0:17119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99eeef91a800/0x8475908e9fd23ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330371.428999:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eeef91a800/0x8475908e9fd23ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1788330371.437981:0:19425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788330371.442236:0:19425:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788330371.442250:0:19425:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788330371.442298:0:19425:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788330371.442357:0:19425:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.150@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788330371.442376:0:19425:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788330371.442398:0:19425:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788330371.443274:0:19425:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788330371.443523:0:19425:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788330371.675381:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330371.995510:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330371.995545:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792462976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788330371.995650:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330371.995941:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792462976 00000100:00100000:2.0:1788330371.995954:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792462976 00000100:00100000:2.0:1788330371.996029:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788330371.996041:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792462976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788330371.996073:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788330371.996180:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792462976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330371.996189:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788330371.996274:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792462976:0@lo:13:osp-pre-0-1.0 00000020:00000004:0.0:1788330372.615140:0:19492:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788330372.616789:0:19492:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788330372.701550:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330373.022048:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330373.022086:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792463104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788330373.022206:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330373.022267:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792463104 00000100:00100000:0.0:1788330373.022276:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792463104 00000100:00100000:0.0:1788330373.022337:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788330373.022347:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792463104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330373.022414:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788330373.022474:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792463104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330373.022482:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788330373.022545:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792463104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788330373.023966:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330373.023987:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792463232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330373.024070:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330373.024175:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792463232 00000100:00100000:3.0:1788330373.024183:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792463232 00000100:00100000:3.0:1788330373.024228:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788330373.024238:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792463232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788330373.024278:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788330373.024326:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792463232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330373.024334:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788330373.024393:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792463232:0@lo:41:osp-pre-0-1.0 10000000:01000000:2.0:1788330373.148746:0:17101:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788330373.148759:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99eee721d800 from 10 10000000:01000000:2.0:1788330373.148765:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788330373.148855:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9039e00/0x8475908e9fd23d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330373.148872:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eec9039e00/0x8475908e9fd23d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330373.148891:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eec9039e00/0x8475908e9fd23d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330373.148943:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7695500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792463360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788330373.149063:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330373.149139:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec920cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788330373.150593:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792463360 00000100:00100000:3.0:1788330373.150629:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792463360 00000100:00100000:3.0:1788330373.150760:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788330373.150777:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc661c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:17101:x1875199792463360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330373.150806:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330373.151074:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eeef91ae00/0x8475908e9fd23dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd23d5 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330373.151121:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eeef91ae00/0x8475908e9fd23dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd23d5 expref: 23 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330373.151185:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eeef91ae00/0x8475908e9fd23dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd23d5 expref: 23 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330373.151198:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eeef91ae00, rc 0) 00000100:00100000:3.0:1788330373.152689:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc661c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:17101:x1875199792463360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1902us (3612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330373.152708:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788330373.157955:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7695500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792463360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330373.158002:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eec9039e00/0x8475908e9fd23d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd23dc expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330373.158018:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eec9039e00/0x8475908e9fd23d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd23dc expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330373.160083:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792463488:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788330373.160224:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330373.160346:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eecd9c20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330373.163613:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792463488 00000100:00100000:2.0:1788330373.163641:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792463488 00000100:00100000:3.0:1788330373.166457:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788330373.166478:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:17101:x1875199792463488:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788330373.166536:0:17098:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788330373.166565:0:17098:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788330373.166569:0:17098:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788330373.167320:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:17101:x1875199792463488:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 843us (7091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330373.167333:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788330373.170836:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792463488:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788330373.171258:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788330373.171277:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eec9039e00/0x8475908e9fd23d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd23dc expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330373.171292:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eec9039e00/0x8475908e9fd23d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd23dc expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330373.171307:0:17101:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788330373.171311:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99edc7d05800 from 10 10000000:01000000:3.0:1788330373.171315:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788330373.171378:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eeef91a800/0x8475908e9fd23e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330373.171404:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eeef91a800/0x8475908e9fd23e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330373.171416:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eeef91a800/0x8475908e9fd23e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330373.171462:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792463616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788330373.171567:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330373.171629:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330373.172233:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792463616 00000100:00100000:1.0:1788330373.172244:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792463616 00000100:00100000:1.0:1788330373.172304:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788330373.172317:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:17101:x1875199792463616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330373.172334:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330373.172351:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eefe7eee00/0x8475908e9fd23ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd23e3 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330373.172380:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eefe7eee00/0x8475908e9fd23ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd23e3 expref: 24 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330373.172392:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eefe7eee00/0x8475908e9fd23ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd23e3 expref: 24 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330373.172402:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eefe7eee00, rc 0) 00000100:00100000:1.0:1788330373.172490:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:17101:x1875199792463616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330373.172499:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788330373.172758:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792463616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330373.172778:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eeef91a800/0x8475908e9fd23e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd23ea expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330373.172789:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eeef91a800/0x8475908e9fd23e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd23ea expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330373.173014:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792463744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788330373.173061:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330373.173101:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330373.173197:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792463744 00000100:00100000:1.0:1788330373.173203:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792463744 00000100:00100000:1.0:1788330373.173244:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788330373.173254:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:17101:x1875199792463744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788330373.173271:0:17098:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788330373.173293:0:17098:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788330373.173297:0:17098:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788330373.173384:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:17101:x1875199792463744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330373.173392:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788330373.173488:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792463744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788330373.173556:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788330373.173564:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eeef91a800/0x8475908e9fd23e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd23ea expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330373.173572:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eeef91a800/0x8475908e9fd23e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd23ea expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330373.723405:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788330373.916862:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788330374.747653:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330375.776285:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330376.091445:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330376.091484:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792463872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330376.091599:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330376.091958:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792463872 00000100:00100000:2.0:1788330376.091970:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792463872 00000100:00100000:2.0:1788330376.092055:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788330376.092067:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792463872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330376.092104:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788330376.092182:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792463872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330376.092190:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788330376.092275:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792463872:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788330376.092354:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788330376.603593:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330376.603602:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788330376.603607:0:37:0:(import.c:65:import_set_state_nolock()) ffff99eee721f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330376.603636:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99eee721f000 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330376.603666:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc8451c00 x1875199792464256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788330376.603708:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330376.603712:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788330376.603729:0:37:0:(import.c:65:import_set_state_nolock()) ffff99edc7e25800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330376.603734:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99edc7e25800 using connection 192.168.202.150@tcp/0@lo 00000100:00100000:1.0:1788330376.603749:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99edc8451880 x1875199792464768/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788330376.603819:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792464512:0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.603916:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330376.604015:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792465152:0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.604047:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330376.604077:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788330376.604084:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792464000:0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.604116:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330376.604172:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792464640:0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.604201:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330376.604221:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792465280:0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.604250:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330376.604279:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792464128:0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.604305:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330376.604325:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792464896:0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.604347:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330376.604365:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792465408:0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.604389:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330376.604408:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788330376.604414:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792464384:0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.604437:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330376.604458:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792465024:0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.604481:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330376.604513:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792464512 00000100:00100000:1.0:1788330376.604521:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792464512 00000100:00100000:1.0:1788330376.604567:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792464128 00000100:00100000:1.0:1788330376.604570:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792464128 00000100:00100000:1.0:1788330376.604589:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788330376.604599:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792464512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.604686:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792464512:12345-0@lo:400:kworker.0 Request processed in 87us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330376.604695:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788330376.604715:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788330376.604722:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792464128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.604755:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792464128:12345-0@lo:400:kworker.0 Request processed in 35us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330376.604762:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788330376.604801:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792465152 00000100:00100000:1.0:1788330376.604805:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792465152 00000100:00100000:1.0:1788330376.604840:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792465280 00000100:00100000:1.0:1788330376.604843:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792465280 00000100:00100000:1.0:1788330376.604856:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792464896 00000100:00100000:1.0:1788330376.604859:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792464896 00000100:00100000:1.0:1788330376.604869:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792465408 00000100:00100000:1.0:1788330376.604871:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792465408 00000100:00100000:1.0:1788330376.604882:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792464384 00000100:00100000:1.0:1788330376.604885:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792464384 00000100:00100000:1.0:1788330376.604895:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792465024 00000100:00100000:1.0:1788330376.604897:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792465024 00000100:00100000:1.0:1788330376.604910:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788330376.604916:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792465152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.604955:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792465152:12345-0@lo:400:kworker.0 Request processed in 38us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330376.604961:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788330376.604973:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788330376.604979:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792465280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.605006:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792465280:12345-0@lo:400:kworker.0 Request processed in 27us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330376.605011:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788330376.605023:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788330376.605028:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792464896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.605054:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875199792464896:12345-0@lo:400:kworker.0 Request processed in 26us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330376.605060:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788330376.605071:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788330376.605076:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792465408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.605101:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875199792465408:12345-0@lo:400:kworker.0 Request processed in 25us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330376.605107:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788330376.605118:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788330376.605124:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792464384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.605179:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875199792464384:12345-0@lo:400:kworker.0 Request processed in 54us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330376.605185:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788330376.605197:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788330376.605203:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792465024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.605239:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792465024:12345-0@lo:400:kworker.0 Request processed in 36us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330376.605245:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788330376.605266:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792464000 00000100:00100000:1.0:1788330376.605270:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792464000 00000100:00100000:1.0:1788330376.605298:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788330376.605305:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:3646:x1875199792464000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.605336:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:3646:x1875199792464000:12345-0@lo:400:kworker.0 Request processed in 32us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330376.605343:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788330376.605375:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792464640 00000100:00100000:1.0:1788330376.605379:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792464640 00000100:00100000:1.0:1788330376.605411:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788330376.605418:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792464640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.605448:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792464640:12345-0@lo:400:kworker.0 Request processed in 31us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330376.605454:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788330376.605487:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788330376.605493:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788330376.605495:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788330376.605538:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc8452a00 x1875199792464384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330376.605554:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875199792464384:0@lo:400:kworker.0 00010000:00080000:1.0:1788330376.605564:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc8452680 x1875199792465024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330376.605571:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792465024:0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.605592:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792464128:0@lo:400:kworker.0 00010000:00080000:1.0:1788330376.605600:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc8451500 x1875199792464896/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330376.605608:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875199792464896:0@lo:400:kworker.0 00010000:00080000:1.0:1788330376.605628:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffcf9180 x1875199792465408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330376.605636:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffcf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875199792465408:0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.605681:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792464000:0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.605692:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792464640:0@lo:400:kworker.0 00010000:00080000:1.0:1788330376.605702:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc8453800 x1875199792465280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330376.605711:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792465280:0@lo:400:kworker.0 00000100:00100000:1.0:1788330376.605722:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792464512:0@lo:400:kworker.0 00010000:00080000:1.0:1788330376.605733:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc8453480 x1875199792465152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330376.605741:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792465152:0@lo:400:kworker.0 00000100:00100000:2.0:1788330376.605890:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792464256:0@lo:8:kworker.0 00000100:00100000:2.0:1788330376.605931:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330376.605963:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792464768:0@lo:8:kworker.0 00000100:00100000:2.0:1788330376.605985:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330376.606018:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792464256 00000100:00100000:2.0:1788330376.606022:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792464256 00000100:00100000:2.0:1788330376.606045:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792464768 00000100:00100000:2.0:1788330376.606047:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792464768 00000100:00100000:2.0:1788330376.606060:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788330376.606065:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1875199792464256:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788330376.606095:0:18613:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 580 last 0 00000020:00000080:2.0:1788330376.606133:0:18613:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8475908e9fd23f1 00002000:00100000:2.0:1788330376.606191:0:18613:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99edc64ae000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788330376.606196:0:18613:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788330376.606200:0:18613:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788330376.606428:0:18613:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788330376.606466:0:18613:0:(import.c:65:import_set_state_nolock()) ffff99edc64ac000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330376.606517:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875199792464256:12345-0@lo:8:kworker.0 Request processed in 450us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330376.606524:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788330376.606542:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788330376.606546:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1875199792464768:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788330376.606561:0:18613:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 580 last 0 00000020:00000080:2.0:1788330376.606577:0:18613:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x8475908e9fd23f8 00002000:00100000:2.0:1788330376.606584:0:18613:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff99edc64ad800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788330376.606597:0:18613:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1788330376.606599:0:18613:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788330376.606640:0:18613:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788330376.606653:0:18613:0:(import.c:65:import_set_state_nolock()) ffff99edc64a8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330376.606682:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1875199792464768:12345-0@lo:8:kworker.0 Request processed in 133us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330376.606689:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788330376.606727:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc8451c00 x1875199792464256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788330401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788330376.606743:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788330376.606755:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788330376.606760:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788330376.606763:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99eee721f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788330376.606785:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788330376.606791:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875199792464256:0@lo:8:kworker.0 00010000:00080000:2.0:1788330376.606805:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc8451880 x1875199792464768/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788330401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788330376.606813:0:3645:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788330376.606818:0:3645:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788330376.606822:0:3645:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788330376.606824:0:3645:0:(import.c:65:import_set_state_nolock()) ffff99edc7e25800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788330376.606839:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788330376.606842:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875199792464768:0@lo:8:kworker.0 00000004:00080000:2.0:1788330376.606917:0:17130:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1788330376.606942:0:17130:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17130:1875199792465664:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788330376.606979:0:17130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330376.607001:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc5cc0540 going to sleep for 11 seconds 00000004:00080000:2.0:1788330376.607030:0:17848:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788330376.607048:0:17848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17848:1875199792465920:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788330376.607070:0:17848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330376.607085:0:17848:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc5cc06c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788330376.607102:0:17847:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788330376.607211:0:17847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 580579060021ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788330376.607220:0:17847:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788330376.607420:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792465664 00000100:00100000:2.0:1788330376.607428:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792465664 00000100:00100000:2.0:1788330376.607469:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792465920 00000100:00100000:2.0:1788330376.607472:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792465920 00000100:00100000:2.0:1788330376.607487:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788330376.607494:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17130:x1875199792465664:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1788330376.607715:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788330376.607730:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788330376.607785:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17848:x1875199792465920:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788330376.608100:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788330376.608117:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792465792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788330376.608209:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330376.608402:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792465536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330376.608437:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788330376.608510:0:17129:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788330376.608592:0:17129:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 580580441104ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788330376.608598:0:17129:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788330376.608683:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792465792 00000100:00100000:2.0:1788330376.608691:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792465792 00000100:00100000:2.0:1788330376.608719:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792465536 00000100:00100000:2.0:1788330376.608721:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792465536 00000100:00100000:2.0:1788330376.608735:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788330376.608742:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7641880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875199792465792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788330376.608767:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788330376.608837:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7641880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875199792465792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330376.608844:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788330376.608869:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788330376.608876:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875199792465536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788330376.608886:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788330376.608916:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875199792465536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330376.608922:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788330376.608994:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7694700 x1875199792465536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330376.609017:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792465536:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788330376.609049:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7696300 x1875199792465792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330376.609061:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792465792:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1788330376.615355:0:17837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:1.0:1788330376.621223:0:17083:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:0.0:1788330376.634785:0:18802:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788330376.634802:0:18802:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788330376.634809:0:18802:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00010000:0.0:1788330376.655795:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330376.655814:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a41a2b1/0x8475908e9fd23ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.657996:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=580s v=(0 0) 00010000:00010000:0.0:1788330376.658003:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330376.658013:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a41a2b1/0x8475908e9fd23ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.658043:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a41a2b1/0x8475908e9fd23ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.658057:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a41a2b1/0x8475908e9fd23ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.658066:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a41a2b1/0x8475908e9fd23ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.661920:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788330376.662658:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330376.662673:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2406 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.662694:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=580s v=(0 0) 00010000:00010000:1.0:1788330376.662699:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330376.662707:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2406 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.662724:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2406 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.662736:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2406 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.662744:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2406 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.662763:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788330376.662774:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788330376.662782:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a41a2b1/0x8475908e9fd23ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.662790:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330376.662795:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a41a2b1/0x8475908e9fd23ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.662813:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a41a2b1/0x8475908e9fd23ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788330376.662915:0:18613:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788330376.662924:0:18613:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788330376.663480:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17848:x1875199792465920:12345-0@lo:7:osp-pre-1-1.0 Request processed in 55732us (56398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330376.663496:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788330376.663508:0:17848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17848:1875199792465920:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788330376.663532:0:17848:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788330376.663720:0:17848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5ee8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17848:1875199792466048:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788330376.663766:0:17848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330376.663803:0:17848:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee733e780 going to sleep for 11 seconds 00010000:00010000:3.0:1788330376.664064:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330376.664073:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2406 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.664100:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330376.664104:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2406 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.664115:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2406 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.664144:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2406 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.664185:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2406 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.664213:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330376.664216:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330376.664217:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330376.665006:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a41a2b1/0x8475908e9fd23ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.665020:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a41a2b1/0x8475908e9fd23ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.665047:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330376.665049:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330376.665052:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330376.665339:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792466048 00000100:00100000:0.0:1788330376.665351:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792466048 00000100:00100000:0.0:1788330376.665450:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788330376.665464:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17848:x1875199792466048:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788330376.665519:0:18612:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788330376.665614:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17848:x1875199792466048:12345-0@lo:5:osp-pre-1-1.0 Request processed in 153us (1847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330376.665631:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00002000:00010000:1.0:1788330376.665840:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330376.665850:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd240d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.665866:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=580s v=(0 0) 00010000:00010000:1.0:1788330376.665871:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330376.665880:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd240d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.665895:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd240d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.665907:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd240d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.665923:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd240d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.665945:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788330376.666266:0:17848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5ee8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17848:1875199792466048:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788330376.666283:0:17848:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788330376.666338:0:17848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70fb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17848:1875199792466176:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788330376.666391:0:17848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330376.668405:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330376.668422:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd240d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.668435:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7eec00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330376.668440:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd240d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.668463:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd240d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.668488:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd240d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.668493:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd240d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.668513:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330376.668515:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330376.668516:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330376.673698:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792466176 00000100:00100000:3.0:1788330376.673725:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792466176 00000100:00100000:3.0:1788330376.673805:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788330376.673819:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17848:x1875199792466176:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788330376.673879:0:18610:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:0.0:1788330376.678028:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330376.678050:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016983baa/0x8475908e9fd2414 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.678074:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=580s v=(0 0) 00010000:00010000:0.0:1788330376.678079:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330376.678087:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016983baa/0x8475908e9fd2414 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.678104:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016983baa/0x8475908e9fd2414 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.678116:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016983baa/0x8475908e9fd2414 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.678125:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016983baa/0x8475908e9fd2414 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.678172:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330376.678188:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330376.678196:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016983baa/0x8475908e9fd2414 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.678223:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330376.678229:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016983baa/0x8475908e9fd2414 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.678238:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016983baa/0x8475908e9fd2414 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.678260:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016983baa/0x8475908e9fd2414 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.678267:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016983baa/0x8475908e9fd2414 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.678296:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330376.678298:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330376.678300:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330376.678988:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330376.678997:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f769168/0x8475908e9fd241b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.679009:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=580s v=(0 0) 00010000:00010000:0.0:1788330376.679012:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330376.679016:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f769168/0x8475908e9fd241b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.679025:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f769168/0x8475908e9fd241b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.679041:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f769168/0x8475908e9fd241b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.679048:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f769168/0x8475908e9fd241b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.679076:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788330376.679394:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330376.679401:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd2422 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.679411:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=580s v=(0 0) 00010000:00010000:0.0:1788330376.679414:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330376.679418:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd2422 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.679429:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd2422 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.679436:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd2422 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.679444:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd2422 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.679476:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788330376.679490:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788330376.679495:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f769168/0x8475908e9fd241b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.679503:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330376.679508:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f769168/0x8475908e9fd241b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.679517:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f769168/0x8475908e9fd241b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.679533:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f769168/0x8475908e9fd241b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.679540:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f769168/0x8475908e9fd241b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.679558:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330376.679561:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd2422 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.679567:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330376.679570:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd2422 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.679587:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd2422 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.679597:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd2422 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.679604:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd2422 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.679629:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330376.679631:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330376.679633:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330376.680545:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330376.680556:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074d511af/0x8475908e9fd2429 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.680568:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=580s v=(0 0) 00010000:00010000:0.0:1788330376.680571:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330376.680576:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074d511af/0x8475908e9fd2429 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.680587:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074d511af/0x8475908e9fd2429 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.680596:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074d511af/0x8475908e9fd2429 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.680610:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074d511af/0x8475908e9fd2429 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.681264:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330376.681282:0:17848:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eecd9c20c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788330376.688021:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330376.688315:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330376.688328:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074d511af/0x8475908e9fd2429 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.688344:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79c00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330376.688351:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d511af/0x8475908e9fd2429 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.688364:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d511af/0x8475908e9fd2429 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.688392:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074d511af/0x8475908e9fd2429 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.688401:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074d511af/0x8475908e9fd2429 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.688427:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330376.688430:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330376.688432:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330376.689458:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330376.689471:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd2430 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.689489:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=580s v=(0 0) 00010000:00010000:1.0:1788330376.689495:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330376.689503:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd2430 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.689518:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd2430 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.689529:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd2430 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.689544:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd2430 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.689566:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330376.690181:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330376.690193:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd2430 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.690214:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330376.690219:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd2430 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.690229:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd2430 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.690250:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd2430 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.690259:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd2430 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.690280:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330376.690282:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330376.690284:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330376.694667:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330376.694686:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2437 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.694708:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=580s v=(0 0) 00010000:00010000:1.0:1788330376.694715:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330376.694723:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2437 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.694742:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2437 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.694756:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2437 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.694765:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2437 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.694787:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330376.694897:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330376.694906:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2437 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.694915:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330376.694922:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2437 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.694933:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2437 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.694966:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2437 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.694974:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2437 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.694997:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330376.695004:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330376.695007:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330376.699715:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330376.699739:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd243e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.699766:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=580s v=(0 0) 00010000:00010000:0.0:1788330376.699772:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330376.699780:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd243e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.699799:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd243e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.699812:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd243e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.699821:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd243e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.699861:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330376.699878:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330376.699885:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd243e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.699893:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330376.699900:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd243e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.699910:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd243e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.699933:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd243e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.699941:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd243e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.699962:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330376.699964:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330376.699966:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330376.704282:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330376.704303:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a2042f6/0x8475908e9fd2445 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.704346:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=580s v=(0 0) 00010000:00010000:1.0:1788330376.704352:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330376.704870:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a2042f6/0x8475908e9fd2445 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.704894:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a2042f6/0x8475908e9fd2445 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.704907:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a2042f6/0x8475908e9fd2445 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.704917:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a2042f6/0x8475908e9fd2445 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.704948:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330376.705608:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330376.705627:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a2042f6/0x8475908e9fd2445 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.705639:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7efc00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330376.705654:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a2042f6/0x8475908e9fd2445 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.705664:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a2042f6/0x8475908e9fd2445 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.705687:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a2042f6/0x8475908e9fd2445 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.705694:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a2042f6/0x8475908e9fd2445 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.705717:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330376.705719:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330376.705721:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330376.706050:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330376.706058:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d5cb267/0x8475908e9fd244c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.706070:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=580s v=(0 0) 00010000:00010000:1.0:1788330376.706075:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330376.706080:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d5cb267/0x8475908e9fd244c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.706092:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d5cb267/0x8475908e9fd244c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.706113:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d5cb267/0x8475908e9fd244c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.706120:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d5cb267/0x8475908e9fd244c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.706138:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788330376.706687:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330376.706694:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2453 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.706704:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=580s v=(0 0) 00010000:00010000:1.0:1788330376.706707:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330376.706712:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2453 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.706723:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2453 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.706731:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2453 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.706737:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2453 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.706771:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788330376.707189:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330376.707196:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd245a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.707205:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=580s v=(0 0) 00010000:00010000:1.0:1788330376.707209:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330376.707213:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd245a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.707222:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd245a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.707230:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd245a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.707238:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd245a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.707261:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788330376.707362:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788330376.707371:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d5cb267/0x8475908e9fd244c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.707381:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330376.707386:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d5cb267/0x8475908e9fd244c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.707396:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d5cb267/0x8475908e9fd244c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.707413:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d5cb267/0x8475908e9fd244c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.707433:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d5cb267/0x8475908e9fd244c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.707451:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788330376.707455:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2453 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.707461:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330376.707464:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2453 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.707471:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2453 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.707482:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2453 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.707490:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2a4bf75/0x8475908e9fd2453 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.707501:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330376.707505:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd245a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.707511:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:2.0:1788330376.707520:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd245a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.707527:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd245a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.707538:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd245a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.707545:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098ca4b7b/0x8475908e9fd245a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.707558:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330376.707559:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330376.707561:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330376.707932:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330376.707939:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd2461 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.707948:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=580s v=(0 0) 00010000:00010000:1.0:1788330376.707957:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330376.707961:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd2461 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.707970:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd2461 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.707977:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd2461 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.707984:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd2461 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.708006:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788330376.708222:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330376.708225:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330376.708228:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd2461 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.708237:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7eec00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330376.708241:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd2461 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.708249:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd2461 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.708261:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd2461 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.708280:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd2461 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.708295:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330376.708296:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330376.708298:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330376.708503:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330376.708508:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2468 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.708516:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=580s v=(0 0) 00010000:00010000:1.0:1788330376.708520:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330376.708524:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2468 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.708533:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2468 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.708540:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2468 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.708547:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2468 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.708563:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330376.708647:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330376.708653:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2468 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.708672:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330376.708675:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2468 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.708683:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2468 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.708695:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2468 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.708701:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062486e6c/0x8475908e9fd2468 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.708719:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330376.708721:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330376.708723:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330376.709770:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330376.709805:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee97ca1a/0x8475908e9fd246f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.709821:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=580s v=(0 0) 00010000:00010000:1.0:1788330376.709824:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330376.709830:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee97ca1a/0x8475908e9fd246f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.709843:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee97ca1a/0x8475908e9fd246f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.709854:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee97ca1a/0x8475908e9fd246f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.709860:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee97ca1a/0x8475908e9fd246f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.709888:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330376.709927:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330376.709935:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee97ca1a/0x8475908e9fd246f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.709945:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330376.709949:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee97ca1a/0x8475908e9fd246f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.709958:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee97ca1a/0x8475908e9fd246f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.710045:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee97ca1a/0x8475908e9fd246f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.710053:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee97ca1a/0x8475908e9fd246f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.710072:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330376.710074:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330376.710076:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330376.713329:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788330376.715538:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788330376.715554:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056ef6306/0x8475908e9fd2476 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.715577:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=580s v=(0 0) 00010000:00010000:2.0:1788330376.715582:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330376.715590:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056ef6306/0x8475908e9fd2476 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.715608:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056ef6306/0x8475908e9fd2476 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.715647:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056ef6306/0x8475908e9fd2476 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.716441:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056ef6306/0x8475908e9fd2476 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.716473:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330376.716483:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330376.716494:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056ef6306/0x8475908e9fd2476 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.716505:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330376.716512:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056ef6306/0x8475908e9fd2476 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.716524:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056ef6306/0x8475908e9fd2476 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.716548:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056ef6306/0x8475908e9fd2476 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.716556:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056ef6306/0x8475908e9fd2476 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.716920:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330376.716923:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330376.716925:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788330376.722825:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788330376.722848:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009747c4b9/0x8475908e9fd247d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.722872:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=580s v=(0 0) 00010000:00010000:2.0:1788330376.722878:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330376.722886:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009747c4b9/0x8475908e9fd247d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.722903:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009747c4b9/0x8475908e9fd247d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.722915:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009747c4b9/0x8475908e9fd247d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.722924:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009747c4b9/0x8475908e9fd247d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.722969:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330376.723039:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330376.723048:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009747c4b9/0x8475908e9fd247d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.723057:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039c00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330376.723062:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009747c4b9/0x8475908e9fd247d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.723071:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009747c4b9/0x8475908e9fd247d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.723090:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009747c4b9/0x8475908e9fd247d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.723098:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009747c4b9/0x8475908e9fd247d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.723125:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330376.723128:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330376.723130:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788330376.724567:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788330376.724584:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006530fc9e/0x8475908e9fd2484 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.724602:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=580s v=(0 0) 00010000:00010000:2.0:1788330376.724607:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330376.724625:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006530fc9e/0x8475908e9fd2484 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.724641:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006530fc9e/0x8475908e9fd2484 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.724651:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006530fc9e/0x8475908e9fd2484 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.724659:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006530fc9e/0x8475908e9fd2484 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330376.724680:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:3.0:1788330376.724774:0:19426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1788330376.724816:0:19426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788330376.724824:0:19426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788330376.725511:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330376.725525:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006530fc9e/0x8475908e9fd2484 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.725536:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039200 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330376.725542:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006530fc9e/0x8475908e9fd2484 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.725552:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006530fc9e/0x8475908e9fd2484 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.725576:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006530fc9e/0x8475908e9fd2484 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.725595:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006530fc9e/0x8475908e9fd2484 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.725634:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330376.725636:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330376.725638:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330376.726076:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17848:x1875199792466176:12345-0@lo:5:osp-pre-1-1.0 Request processed in 52253us (59677us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788330376.726090:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788330376.728176:0:17848:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788330376.728202:0:17848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70fb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17848:1875199792466176:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788330376.728229:0:17848:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788330376.728311:0:17848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17848:1875199792466304:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788330376.728392:0:17848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330376.728434:0:17848:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eecd9c20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330376.731799:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792466304 00000100:00100000:2.0:1788330376.731828:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792466304 00000100:00100000:2.0:1788330376.731928:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788330376.731941:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17848:x1875199792466304:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788330376.732078:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17848:x1875199792466304:12345-0@lo:900:osp-pre-1-1.0 Request processed in 139us (3686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330376.732094:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788330376.732835:0:17848:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eee7640000 x1875199792466304/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788330392 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330376.732857:0:17848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17848:1875199792466304:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1788330376.735088:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330376.735108:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd248b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.735130:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=580s v=(0 0) 00010000:00010000:1.0:1788330376.735136:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330376.735144:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd248b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.735183:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd248b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.735205:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd248b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.735214:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd248b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.735283:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330376.735340:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330376.735350:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd248b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.735362:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7eec00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330376.735369:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd248b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.735379:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd248b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.735400:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd248b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.735407:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000978dedd4/0x8475908e9fd248b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.735441:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330376.735444:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330376.735446:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330376.735933:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330376.735941:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd2492 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.735951:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=580s v=(0 0) 00010000:00010000:0.0:1788330376.735954:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330376.735959:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd2492 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.735970:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd2492 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.735978:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd2492 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.735985:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd2492 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.736013:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330376.736022:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330376.736026:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd2492 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.736033:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330376.736036:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd2492 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.736043:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd2492 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.736054:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd2492 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.736061:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da2aa626/0x8475908e9fd2492 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.736080:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330376.736081:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330376.736083:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330376.736952:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330376.736960:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074d511af/0x8475908e9fd2499 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.736971:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=580s v=(0 0) 00010000:00010000:0.0:1788330376.736984:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330376.736988:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074d511af/0x8475908e9fd2499 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.737001:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074d511af/0x8475908e9fd2499 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.737011:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074d511af/0x8475908e9fd2499 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.737019:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074d511af/0x8475908e9fd2499 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.739693:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330376.741494:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330376.741515:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074d511af/0x8475908e9fd2499 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.741535:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79c00 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330376.741541:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d511af/0x8475908e9fd2499 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.741555:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d511af/0x8475908e9fd2499 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.741584:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074d511af/0x8475908e9fd2499 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.741592:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074d511af/0x8475908e9fd2499 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.741644:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330376.741646:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330376.741648:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330376.742461:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788330376.742474:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f769168/0x8475908e9fd24a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.742492:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=580s v=(0 0) 00010000:00010000:0.0:1788330376.742497:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330376.742506:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f769168/0x8475908e9fd24a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.742523:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f769168/0x8475908e9fd24a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.742533:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f769168/0x8475908e9fd24a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.742553:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f769168/0x8475908e9fd24a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330376.742575:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330376.742916:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330376.742924:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f769168/0x8475908e9fd24a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.742947:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78000 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330376.742952:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f769168/0x8475908e9fd24a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.742962:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f769168/0x8475908e9fd24a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.742978:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f769168/0x8475908e9fd24a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.742986:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f769168/0x8475908e9fd24a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.743006:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330376.743008:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330376.743010:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330376.743886:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330376.743901:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec4ea34b/0x8475908e9fd24a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.743915:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=580s v=(0 0) 00010000:00010000:1.0:1788330376.743919:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330376.743925:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec4ea34b/0x8475908e9fd24a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.743939:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec4ea34b/0x8475908e9fd24a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.743949:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec4ea34b/0x8475908e9fd24a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.743957:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec4ea34b/0x8475908e9fd24a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.743984:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330376.744012:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330376.744018:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec4ea34b/0x8475908e9fd24a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.744026:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330376.744029:0:17858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec4ea34b/0x8475908e9fd24a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.744038:0:17858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec4ea34b/0x8475908e9fd24a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.744060:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec4ea34b/0x8475908e9fd24a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.744067:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec4ea34b/0x8475908e9fd24a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.744084:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330376.744086:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330376.744088:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330376.744744:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330376.744755:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d3988fc/0x8475908e9fd24ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.744765:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=580s v=(0 0) 00010000:00010000:1.0:1788330376.744768:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330376.744773:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d3988fc/0x8475908e9fd24ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.744783:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d3988fc/0x8475908e9fd24ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.744792:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d3988fc/0x8475908e9fd24ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.745225:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d3988fc/0x8475908e9fd24ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.745287:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788330376.745851:0:18802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788330376.745858:0:18802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010bde119/0x8475908e9fd24b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.745869:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=580s v=(0 0) 00010000:00010000:1.0:1788330376.745873:0:18802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330376.745878:0:18802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010bde119/0x8475908e9fd24b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.745902:0:18802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010bde119/0x8475908e9fd24b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.745912:0:18802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010bde119/0x8475908e9fd24b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330376.745920:0:18802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010bde119/0x8475908e9fd24b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.752418:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330376.752439:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d3988fc/0x8475908e9fd24ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.752456:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee600 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330376.752462:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d3988fc/0x8475908e9fd24ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.752474:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d3988fc/0x8475908e9fd24ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.752504:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d3988fc/0x8475908e9fd24ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.752513:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d3988fc/0x8475908e9fd24ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.752599:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330376.752604:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010bde119/0x8475908e9fd24b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.752611:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef600 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:3.0:1788330376.752623:0:17091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010bde119/0x8475908e9fd24b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.752632:0:17091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010bde119/0x8475908e9fd24b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.752643:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010bde119/0x8475908e9fd24b5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.752651:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330376.752653:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330376.752655:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330376.756020:0:18802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788330376.756044:0:18802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010bde119/0x8475908e9fd24b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330376.757061:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788330376.759625:0:18802:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:3.0:1788330376.759819:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17130:x1875199792465664:12345-0@lo:5:osp-pre-1-0.0 Request processed in 152316us (152830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330376.759834:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788330376.760235:0:17130:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17130:1875199792465664:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788330376.760261:0:17130:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1788330376.760338:0:17130:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17130:1875199792466432:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788330376.760403:0:17130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330376.760439:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc745ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788330376.760454:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792466432 00000100:00100000:1.0:1788330376.760466:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792466432 00000100:00100000:1.0:1788330376.760537:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330376.760550:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17130:x1875199792466432:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788330376.760610:0:18612:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:1.0:1788330376.764644:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17130:x1875199792466432:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4084us (4229us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788330376.764661:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330376.764751:0:17130:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17130:1875199792466432:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788330376.764773:0:17130:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:1.0:1788330376.795363:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330377.117247:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792466560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788330377.117353:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330377.117441:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792466560 00000100:00100000:0.0:1788330377.117451:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792466560 00000100:00100000:0.0:1788330377.117512:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788330377.117525:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792466560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788330377.117558:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788330377.117628:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792466560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330377.117638:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788330377.117717:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792466560:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788330377.244806:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788330377.823710:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788330377.992137:0:19782:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg250-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788330378.140928:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330378.140959:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792466688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788330378.141090:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330378.141105:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792466816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330378.141203:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330378.141318:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330378.141393:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792466816 00000100:00100000:2.0:1788330378.141402:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792466816 00000100:00100000:2.0:1788330378.141456:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792466688 00000100:00100000:2.0:1788330378.141460:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792466688 00000100:00100000:2.0:1788330378.141477:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788330378.141756:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792466816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788330378.141926:0:17108:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788330378.142044:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792466816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 555us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330378.142054:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788330378.142083:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788330378.142089:0:17109:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788330378.142094:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792466688:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788330378.142103:0:17109:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00000024:2.0:1788330378.142117:0:17108:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788330378.142199:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792466688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330378.142206:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788330378.142262:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792466688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330378.143037:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792466816:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788330378.850362:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788330379.302747:0:19835:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788330379.303007:0:19835:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788330379.874908:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788330380.354830:0:19885:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788330380.355598:0:19885:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788330380.699261:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330380.699375:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766156416 00000100:00100000:1.0:1788330380.699391:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766156416 00000100:00100000:1.0:1788330380.699451:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 118 00000100:00100000:1.0:1788330380.699461:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2409:x1875199766156416:12345-192.168.202.50@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788330380.699500:0:17097:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9ce3fcfa-33df-4730-b19b-df0f5c7a4b47@192.168.202.50@tcp t0 exp 0000000000000000 cur 584 last 0 00000020:00000080:1.0:1788330380.699542:0:17097:0:(genops.c:1385:class_connect()) connect: client 9ce3fcfa-33df-4730-b19b-df0f5c7a4b47, cookie 0x8475908e9fd24bc 00000100:00080000:1.0:1788330380.699763:0:17097:0:(import.c:65:import_set_state_nolock()) ffff99edc5da2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788330380.699879:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+5:2409:x1875199766156416:12345-192.168.202.50@tcp:250:mount.lustre.0 Request processed in 416us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330380.699889:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 118 00000100:00100000:1.0:1788330380.719119:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330380.719298:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766156544 00000100:00100000:3.0:1788330380.719312:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766156544 00000100:00100000:3.0:1788330380.719386:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 119 00000100:00100000:3.0:1788330380.719402:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+5:14907:x1875199766156544:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788330380.719426:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330380.719452:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eeef91be00/0x8475908e9fd24c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61061d7 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330380.719489:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eeef91be00/0x8475908e9fd24c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061d7 expref: 6 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330380.719502:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eeef91be00/0x8475908e9fd24c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061d7 expref: 6 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330380.719514:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eeef91be00, rc 0) 00000100:00100000:3.0:1788330380.719598:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+6:14907:x1875199766156544:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 200us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330380.719606:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 119 00000100:00100000:3.0:1788330380.723997:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330380.724143:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766156672 00000100:00100000:1.0:1788330380.724195:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766156672 00000100:00100000:1.0:1788330380.724260:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 120 00000100:00100000:1.0:1788330380.724273:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+6:14907:x1875199766156672:12345-192.168.202.50@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788330380.724442:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+6:14907:x1875199766156672:12345-192.168.202.50@tcp:501:mount.lustre.0 Request processed in 170us (460us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788330380.724452:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 120 00000100:00100000:0.0:1788330380.740221:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330380.740345:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766156800 00000100:00100000:1.0:1788330380.740365:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766156800 00000100:00100000:1.0:1788330380.740451:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 121 00000100:00100000:1.0:1788330380.740465:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+6:14907:x1875199766156800:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788330380.740493:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330380.740528:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eefe7ee200/0x8475908e9fd24ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61061de expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330380.740568:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eefe7ee200/0x8475908e9fd24ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061de expref: 7 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330380.740595:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eefe7ee200/0x8475908e9fd24ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61061de expref: 7 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330380.740610:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eefe7ee200, rc 0) 00000100:00100000:1.0:1788330380.740702:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+7:14907:x1875199766156800:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 239us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330380.740710:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 121 00000100:00100000:2.0:1788330380.765337:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330380.765435:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766156928 00000100:00100000:3.0:1788330380.765448:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766156928 00000100:00100000:3.0:1788330380.765529:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 122 00000100:00100000:3.0:1788330380.765542:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+7:14907:x1875199766156928:12345-192.168.202.50@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788330380.765794:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+8:14907:x1875199766156928:12345-192.168.202.50@tcp:501:mount.lustre.0 Request processed in 253us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330380.765804:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 122 00000100:00100000:1.0:1788330380.779486:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330380.780272:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766157056 00000100:00100000:0.0:1788330380.780291:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766157056 00000100:00100000:0.0:1788330380.780365:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 123 00000100:00100000:0.0:1788330380.780379:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+8:14907:x1875199766157056:12345-192.168.202.50@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788330380.780589:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+8:14907:x1875199766157056:12345-192.168.202.50@tcp:503:mount.lustre.0 Request processed in 203us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330380.780599:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 123 00000100:00100000:3.0:1788330380.795059:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330380.795370:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766157184 00000100:00100000:2.0:1788330380.795385:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766157184 00000100:00100000:2.0:1788330380.795457:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 124 00000100:00100000:2.0:1788330380.795471:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+8:14926:x1875199766157184:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788330380.795738:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+8:14926:x1875199766157184:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 268us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330380.795749:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 124 00000100:00100000:2.0:1788330380.832918:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330380.833104:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766157312 00000100:00100000:3.0:1788330380.833118:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766157312 00000100:00100000:3.0:1788330380.833229:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 125 00000100:00100000:3.0:1788330380.833243:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+8:14926:x1875199766157312:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788330380.833445:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+8:14926:x1875199766157312:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 204us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330380.833455:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 125 00000100:00100000:1.0:1788330380.840533:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330380.840667:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766157440 00000100:00100000:0.0:1788330380.840680:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766157440 00000100:00100000:0.0:1788330380.840763:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 126 00000100:00100000:0.0:1788330380.840777:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+8:14926:x1875199766157440:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788330380.841204:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+8:14926:x1875199766157440:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 428us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330380.841214:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 126 00000100:00100000:0.0:1788330380.860473:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330380.860630:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766157568 00000100:00100000:2.0:1788330380.860644:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766157568 00000100:00100000:2.0:1788330380.860718:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 127 00000100:00100000:2.0:1788330380.860732:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc746d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+8:14907:x1875199766157568:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788330380.860927:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330380.860953:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec9039c00/0x8475908e9fd24d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610620f expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330380.860997:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9039c00/0x8475908e9fd24d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610620f expref: 9 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330380.861010:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec9039c00/0x8475908e9fd24d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610620f expref: 9 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330380.861021:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039c00, rc 0) 00000100:00100000:2.0:1788330380.861112:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc746d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+9:14907:x1875199766157568:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 382us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330380.861120:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 127 00000100:00100000:0.0:1788330380.864197:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330380.864368:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766157696 00000100:00100000:1.0:1788330380.864383:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766157696 00000100:00100000:1.0:1788330380.864459:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 128 00000100:00100000:1.0:1788330380.864472:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+9:14907:x1875199766157696:12345-192.168.202.50@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788330380.864510:0:17095:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788330380.864542:0:17095:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788330380.864546:0:17095:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788330380.864549:0:17095:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788330380.864552:0:17095:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788330380.864555:0:17095:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788330380.866574:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+9:14907:x1875199766157696:12345-192.168.202.50@tcp:256:mount.lustre.0 Request processed in 2089us (2377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330380.866602:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 128 00000100:00100000:0.0:1788330380.876471:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330380.876850:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766157824 00000100:00100000:2.0:1788330380.876865:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766157824 00000100:00100000:2.0:1788330380.876994:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 129 00000100:00100000:2.0:1788330380.877010:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+9:14907:x1875199766157824:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788330380.877037:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330380.877080:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec9038800/0x8475908e9fd24d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106216 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330380.877119:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9038800/0x8475908e9fd24d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106216 expref: 10 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330380.877133:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec9038800/0x8475908e9fd24d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106216 expref: 10 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330380.877146:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038800, rc 0) 00000100:00100000:2.0:1788330380.877271:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+10:14907:x1875199766157824:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 264us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330380.877280:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 129 00000100:00100000:0.0:1788330380.884368:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330380.884473:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766157952 00000100:00100000:1.0:1788330380.884497:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766157952 00000100:00100000:1.0:1788330380.884566:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 130 00000100:00100000:1.0:1788330380.884588:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc77df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+10:14907:x1875199766157952:12345-192.168.202.50@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788330380.884835:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc77df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+10:14907:x1875199766157952:12345-192.168.202.50@tcp:501:mount.lustre.0 Request processed in 257us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330380.884844:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 130 00000100:00100000:1.0:1788330380.890467:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330380.891082:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766158080 00000100:00100000:0.0:1788330380.891099:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766158080 00000100:00100000:0.0:1788330380.891269:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 131 00000100:00100000:0.0:1788330380.891284:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+10:14907:x1875199766158080:12345-192.168.202.50@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788330380.891642:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+10:14907:x1875199766158080:12345-192.168.202.50@tcp:503:mount.lustre.0 Request processed in 359us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330380.891659:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 131 00000100:00100000:1.0:1788330380.895399:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330380.896112:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766158208 00000100:00100000:2.0:1788330380.896128:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766158208 00000100:00100000:2.0:1788330380.896238:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 132 00000100:00100000:2.0:1788330380.896253:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+10:14932:x1875199766158208:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788330380.896457:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+10:14932:x1875199766158208:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 206us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330380.896465:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 132 00010000:00010000:3.0:1788330380.906106:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330380.907850:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330380.908012:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766158336 00000100:00100000:3.0:1788330380.908030:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766158336 00000100:00100000:3.0:1788330380.908108:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 133 00000100:00100000:3.0:1788330380.908123:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+10:14932:x1875199766158336:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788330380.908385:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+10:14932:x1875199766158336:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 265us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330380.908394:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 133 00000100:00100000:1.0:1788330380.922456:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330380.922568:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330380.922691:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766158464 00000100:00100000:0.0:1788330380.922704:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766158464 00000100:00100000:0.0:1788330380.922768:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766158720 00000100:00100000:0.0:1788330380.922772:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766158720 00000100:00100000:0.0:1788330380.922807:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:0.0:1788330380.922819:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2409:x1875199766158464:12345-192.168.202.50@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788330380.922858:0:17104:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 99dd523a-1cb7-4908-afb4-ee09ad740fbd@192.168.202.50@tcp t0 exp 0000000000000000 cur 584 last 0 00000020:00000080:0.0:1788330380.922930:0:17104:0:(genops.c:1385:class_connect()) connect: client 99dd523a-1cb7-4908-afb4-ee09ad740fbd, cookie 0x8475908e9fd24df 00000004:00100000:0.0:1788330380.922966:0:17104:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788330380.923274:0:17104:0:(import.c:65:import_set_state_nolock()) ffff99edc5f72800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330380.923373:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:2409:x1875199766158464:12345-192.168.202.50@tcp:38:mount.lustre.0 Request processed in 553us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330380.923381:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:0.0:1788330380.923407:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:0.0:1788330380.923412:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2409:x1875199766158720:12345-192.168.202.50@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788330380.923430:0:17104:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 99dd523a-1cb7-4908-afb4-ee09ad740fbd@192.168.202.50@tcp t0 exp 0000000000000000 cur 584 last 0 00000020:00000080:0.0:1788330380.923465:0:17104:0:(genops.c:1385:class_connect()) connect: client 99dd523a-1cb7-4908-afb4-ee09ad740fbd, cookie 0x8475908e9fd24e6 00000004:00100000:0.0:1788330380.923480:0:17104:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788330380.923664:0:17104:0:(import.c:65:import_set_state_nolock()) ffff99eeded7d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330380.923692:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:2409:x1875199766158720:12345-192.168.202.50@tcp:38:mount.lustre.0 Request processed in 278us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330380.923699:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:1.0:1788330380.942251:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330380.942295:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330380.942394:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766158848 00000100:00100000:2.0:1788330380.942407:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766158848 00000100:00100000:2.0:1788330380.942498:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766158592 00000100:00100000:2.0:1788330380.942501:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766158592 00000100:00100000:2.0:1788330380.942530:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:2.0:1788330380.942542:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:0:x1875199766158848:12345-192.168.202.50@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788330380.942618:0:17103:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788330380.942847:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:3.0:1788330380.942859:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:0:x1875199766158592:12345-192.168.202.50@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788330380.942882:0:18635:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788330380.942933:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:0:x1875199766158592:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 78us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330380.942951:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:2.0:1788330380.943077:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:0:x1875199766158848:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 536us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330380.943085:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00080000:1.0:1788330380.944243:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788330380.944255:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788330380.947507:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330380.948189:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766158976 00000100:00100000:3.0:1788330380.948204:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766158976 00000100:00100000:3.0:1788330380.948294:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:3.0:1788330380.948308:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:14907:x1875199766158976:12345-192.168.202.50@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788330380.948352:0:18635:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788330380.948460:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:14907:x1875199766158976:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 155us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330380.948468:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:1.0:1788330380.959241:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330380.959361:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766159104 00000100:00100000:0.0:1788330380.959395:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766159104 00000100:00100000:0.0:1788330380.959479:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:0.0:1788330380.959505:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:14907:x1875199766159104:12345-192.168.202.50@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788330380.959721:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:14907:x1875199766159104:12345-192.168.202.50@tcp:40:mount.lustre.0 Request processed in 218us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330380.959731:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:1.0:1788330380.968313:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330380.968371:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330380.968409:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330380.968524:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766159232 00000100:00100000:0.0:1788330380.968539:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766159232 00000100:00100000:0.0:1788330380.968601:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766159360 00000100:00100000:0.0:1788330380.968606:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766159360 00000100:00100000:0.0:1788330380.968639:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:0.0:1788330380.968650:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2409:x1875199766159232:12345-192.168.202.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788330380.968700:0:18610:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 99dd523a-1cb7-4908-afb4-ee09ad740fbd@192.168.202.50@tcp t0 exp 0000000000000000 cur 584 last 0 00000020:00000080:0.0:1788330380.968760:0:18610:0:(genops.c:1385:class_connect()) connect: client 99dd523a-1cb7-4908-afb4-ee09ad740fbd, cookie 0x8475908e9fd24ed 00002000:00100000:0.0:1788330380.968778:0:18610:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 99dd523a-1cb7-4908-afb4-ee09ad740fbd/ffff99eeded7a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788330380.968804:0:18610:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788330380.969024:0:18610:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788330380.969060:0:18610:0:(import.c:65:import_set_state_nolock()) ffff99eeded7f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330380.969138:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:2409:x1875199766159232:12345-192.168.202.50@tcp:8:mount.lustre.0 Request processed in 488us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330380.969146:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:0.0:1788330380.969204:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:0.0:1788330380.969210:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2409:x1875199766159360:12345-192.168.202.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788330380.969228:0:18610:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 99dd523a-1cb7-4908-afb4-ee09ad740fbd@192.168.202.50@tcp t0 exp 0000000000000000 cur 584 last 0 00000020:00000080:0.0:1788330380.969245:0:18610:0:(genops.c:1385:class_connect()) connect: client 99dd523a-1cb7-4908-afb4-ee09ad740fbd, cookie 0x8475908e9fd24f4 00002000:00100000:0.0:1788330380.969262:0:18610:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 99dd523a-1cb7-4908-afb4-ee09ad740fbd/ffff99eeded78000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788330380.969275:0:18610:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788330380.969418:0:18610:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788330380.969434:0:18610:0:(import.c:65:import_set_state_nolock()) ffff99eeded7f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330380.969459:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:2409:x1875199766159360:12345-192.168.202.50@tcp:8:mount.lustre.0 Request processed in 248us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330380.969466:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:2.0:1788330380.969699:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766159488 00000100:00100000:2.0:1788330380.969706:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766159488 00000100:00100000:2.0:1788330380.969764:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:2.0:1788330380.969773:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:14907:x1875199766159488:12345-192.168.202.50@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788330380.969812:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:14907:x1875199766159488:12345-192.168.202.50@tcp:900:mount.lustre.0 Request processed in 40us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330380.969818:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:2.0:1788330380.974839:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330380.975010:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766159616 00000100:00100000:3.0:1788330380.975025:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766159616 00000100:00100000:3.0:1788330380.975094:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:3.0:1788330380.975106:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:14907:x1875199766159616:12345-192.168.202.50@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788330380.983479:0:17106:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8213us 00000004:00200000:3.0:1788330380.999451:0:17106:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788330380.999963:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:14907:x1875199766159616:12345-192.168.202.50@tcp:33:mount.lustre.0 Request processed in 24847us (25128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330380.999976:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:1.0:1788330381.179755:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330381.180283:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766159744 00000100:00100000:2.0:1788330381.180299:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766159744 00000100:00100000:2.0:1788330381.180386:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:2.0:1788330381.180400:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:14955:x1875199766159744:12345-192.168.202.50@tcp:101:mkdir.0 00010000:00010000:2.0:1788330381.180428:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330381.180463:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd24fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106247 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330381.180564:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2502 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330381.180591:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2502 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330381.180745:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2502 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330381.180836:0:17103:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788330381.180841:0:17103:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330381.180888:0:17103:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2502 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330381.180922:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd24fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106247 expref: 8 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330381.180947:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2502 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106247 expref: 7 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330381.180957:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99edc10b5000) 00010000:00010000:2.0:1788330381.180961:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330381.180964:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039000, rc 0) 00000100:00100000:2.0:1788330381.181118:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+7:14955:x1875199766159744:12345-192.168.202.50@tcp:101:mkdir.0 Request processed in 720us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330381.181127:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:0.0:1788330381.211523:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788330381.211562:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792466944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330381.211697:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330381.211968:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792466944 00000100:00100000:1.0:1788330381.211979:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792466944 00000100:00100000:1.0:1788330381.212072:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788330381.212085:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792466944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330381.212117:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788330381.212207:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792466944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330381.212214:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788330381.212395:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330381.212446:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792466944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330381.723509:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330381.723540:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc5eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792467072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330381.723851:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330381.724084:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc70f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792467200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330381.724121:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330381.724283:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792467072 00000100:00100000:0.0:1788330381.724295:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792467072 00000100:00100000:0.0:1788330381.724373:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792467200 00000100:00100000:0.0:1788330381.724378:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792467200 00000100:00100000:0.0:1788330381.724401:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788330381.724412:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792467072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788330381.724443:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788330381.724502:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792467072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330381.724510:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788330381.724534:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788330381.724541:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875199792467200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788330381.724551:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788330381.724587:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875199792467200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330381.724601:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788330381.725913:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788330381.726001:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc5eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792467072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788330381.732726:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792467584:0@lo:400:kworker.0 00000100:00100000:3.0:1788330381.732826:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330381.732864:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792468096:0@lo:400:kworker.0 00000100:00100000:3.0:1788330381.732882:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330381.732907:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788330381.732911:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792467456:0@lo:400:kworker.0 00000100:00100000:3.0:1788330381.732946:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330381.732968:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792467968:0@lo:400:kworker.0 00000100:00100000:3.0:1788330381.732981:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330381.732991:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792468480:0@lo:400:kworker.0 00000100:00100000:3.0:1788330381.733010:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330381.733035:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792467584 00000100:00100000:3.0:1788330381.733043:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792467584 00000100:00100000:3.0:1788330381.733096:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792468096 00000100:00100000:3.0:1788330381.733099:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792468096 00000100:00100000:3.0:1788330381.733130:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792467968 00000100:00100000:3.0:1788330381.733132:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792467968 00000100:00100000:2.0:1788330381.733494:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3649:1875199792467328:0@lo:400:kworker.0 00000100:00100000:2.0:1788330381.733536:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330381.733555:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792467840:0@lo:400:kworker.0 00000100:00100000:2.0:1788330381.733591:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330381.733624:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792468352:0@lo:400:kworker.0 00000100:00100000:2.0:1788330381.733649:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330381.733661:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788330381.733672:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792467712:0@lo:400:kworker.0 00000100:00100000:2.0:1788330381.733695:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330381.733716:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792468224:0@lo:400:kworker.0 00000100:00100000:2.0:1788330381.733736:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330381.733763:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792467456 00000100:00100000:2.0:1788330381.733767:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792467456 00000100:00100000:2.0:1788330381.733799:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792467712 00000100:00100000:2.0:1788330381.733801:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792467712 00000100:00100000:2.0:1788330381.733817:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788330381.733828:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792467456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330381.733894:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792467456:12345-0@lo:400:kworker.0 Request processed in 68us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330381.733902:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788330381.733924:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788330381.733931:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792467712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330381.733963:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792467712:12345-0@lo:400:kworker.0 Request processed in 32us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330381.733969:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788330381.734018:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792467712:0@lo:400:kworker.0 00000100:00100000:2.0:1788330381.734059:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792467456:0@lo:400:kworker.0 00000100:00100000:2.0:1788330381.734080:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792468480 00000100:00100000:2.0:1788330381.734084:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792468480 00000100:00100000:2.0:1788330381.734108:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792468352 00000100:00100000:2.0:1788330381.734118:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792468352 00000100:00100000:2.0:1788330381.734254:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792468224 00000100:00100000:2.0:1788330381.734258:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792468224 00000100:00100000:3.0:1788330381.734531:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788330381.734540:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792467584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330381.734603:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792467584:12345-0@lo:400:kworker.0 Request processed in 65us (1776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330381.734609:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788330381.734624:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788330381.734631:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792468096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330381.734661:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792468096:12345-0@lo:400:kworker.0 Request processed in 31us (1777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330381.734667:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788330381.734677:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788330381.734684:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792468480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330381.734707:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792468480:12345-0@lo:400:kworker.0 Request processed in 24us (1696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330381.734712:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788330381.734732:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788330381.734737:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792468352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330381.734766:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792468352:12345-0@lo:400:kworker.0 Request processed in 30us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330381.734772:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788330381.734781:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788330381.734787:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792468224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330381.734811:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875199792468224:12345-0@lo:400:kworker.0 Request processed in 24us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330381.734816:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788330381.734825:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788330381.734831:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792467968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330381.734855:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792467968:12345-0@lo:400:kworker.0 Request processed in 25us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330381.734860:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788330381.734883:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788330381.734888:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330381.734974:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792467840 00000100:00100000:0.0:1788330381.734980:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792467840 00000100:00100000:0.0:1788330381.735027:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788330381.735035:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792467840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330381.735075:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792467840:12345-0@lo:400:kworker.0 Request processed in 42us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330381.735081:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788330381.735101:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330381.735117:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792467328 00000100:00100000:0.0:1788330381.735121:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792467328 00000100:00100000:1.0:1788330381.739977:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc70f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792467200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330381.740106:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792467968:0@lo:400:kworker.0 00010000:00080000:2.0:1788330381.740129:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7db0700 x1875199792468480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330381.740495:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792468480:0@lo:400:kworker.0 00000100:00100000:2.0:1788330381.740522:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792467584:0@lo:400:kworker.0 00000100:00100000:2.0:1788330381.740536:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792468096:0@lo:400:kworker.0 00010000:00080000:3.0:1788330381.740676:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc7e74700 x1875199792468224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330381.740688:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875199792468224:0@lo:400:kworker.0 00000100:00100000:3.0:1788330381.740704:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792467840:0@lo:400:kworker.0 00000100:00100000:3.0:1788330381.740728:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792468352:0@lo:400:kworker.0 00000100:00100000:0.0:1788330381.741794:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788330381.741819:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:3649:x1875199792467328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330381.741963:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:3649:x1875199792467328:12345-0@lo:400:kworker.0 Request processed in 155us (8424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330381.741971:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788330381.742202:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3649:1875199792467328:0@lo:400:kworker.0 00010000:00010000:3.0:1788330381.915493:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330382.237053:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330382.237084:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792468608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330382.237220:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330382.242719:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792468608 00000100:00100000:0.0:1788330382.242752:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792468608 00000100:00100000:0.0:1788330382.242829:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788330382.242843:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792468608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788330382.242890:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788330382.243032:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792468608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 192us (5811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330382.243041:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000001:00100000:3.0:1788330382.243594:0:19426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99dd523a-1cb7-4908-afb4-ee09ad740fbd 00000100:00100000:2.0:1788330382.244083:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792468608:0@lo:13:osp-pre-0-1.0 00000001:00080000:3.0:1788330382.244204:0:19426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:1.0:1788330382.939416:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788330383.135935:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788330383.259998:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788330383.260039:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792468736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330383.260176:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330383.260247:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792468736 00000100:00100000:0.0:1788330383.260268:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792468736 00000100:00100000:0.0:1788330383.260344:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788330383.260372:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792468736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330383.260426:0:17108:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788330383.260486:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792468736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330383.260493:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788330383.260889:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788330383.260905:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792468864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330383.260950:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330383.261015:0:19787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792468864 00000100:00100000:3.0:1788330383.261021:0:19787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792468864 00000100:00100000:3.0:1788330383.261073:0:19787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788330383.261083:0:19787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792468864:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788330383.261094:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792468736:0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788330383.261108:0:19787:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788330383.261192:0:19787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792468864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330383.261200:0:19787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788330383.261320:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792468864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330383.573069:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330383.573239:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766159872 00000100:00100000:3.0:1788330383.573253:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766159872 00000100:00100000:3.0:1788330383.573391:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:3.0:1788330383.573404:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+7:15007:x1875199766159872:12345-192.168.202.50@tcp:41:lfs.0 00000004:00000024:3.0:1788330383.573458:0:17105:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788330383.573594:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+7:15007:x1875199766159872:12345-192.168.202.50@tcp:41:lfs.0 Request processed in 185us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330383.573609:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00080000:0.0:1788330383.573695:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330383.581452:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330383.581594:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766160000 00000100:00100000:2.0:1788330383.581620:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766160000 00000100:00100000:2.0:1788330383.581726:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:2.0:1788330383.581740:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:15007:x1875199766160000:12345-192.168.202.50@tcp:41:lfs.0 00000004:00000024:2.0:1788330383.581786:0:17103:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788330383.581930:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:15007:x1875199766160000:12345-192.168.202.50@tcp:41:lfs.0 Request processed in 192us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330383.581940:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00080000:0.0:1788330383.582507:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788330383.592781:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330383.594426:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766160128 00000100:00100000:0.0:1788330383.594447:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766160128 00000100:00100000:0.0:1788330383.594863:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:0.0:1788330383.594880:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:15007:x1875199766160128:12345-192.168.202.50@tcp:13:lfs.0 00002000:00000024:0.0:1788330383.594918:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788330383.595052:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:15007:x1875199766160128:12345-192.168.202.50@tcp:13:lfs.0 Request processed in 176us (2284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330383.595061:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00080000:3.0:1788330383.596071:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330383.603394:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330383.603765:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766160256 00000100:00100000:0.0:1788330383.603778:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766160256 00000100:00100000:0.0:1788330383.603913:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:0.0:1788330383.603926:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:15007:x1875199766160256:12345-192.168.202.50@tcp:13:lfs.0 00002000:00000024:0.0:1788330383.603968:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788330383.604102:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:15007:x1875199766160256:12345-192.168.202.50@tcp:13:lfs.0 Request processed in 169us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330383.604111:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00080000:3.0:1788330383.605971:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788330383.897249:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330383.899141:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766160384 00000100:00100000:1.0:1788330383.899177:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766160384 00000100:00100000:1.0:1788330383.899340:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 135 00000100:00100000:1.0:1788330383.899357:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+10:15040:x1875199766160384:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788330383.899380:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330383.899406:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eefe7ef600/0x8475908e9fd2509 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610624e expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330383.899445:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eefe7ef600/0x8475908e9fd2509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610624e expref: 11 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330383.899458:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eefe7ef600/0x8475908e9fd2509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610624e expref: 11 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330383.899468:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eefe7ef600, rc 0) 00000100:00100000:1.0:1788330383.900922:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+11:15040:x1875199766160384:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 1554us (3672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330383.900939:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 135 00000100:00100000:2.0:1788330383.917365:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330383.917840:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766160512 00000100:00100000:3.0:1788330383.917857:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766160512 00000100:00100000:3.0:1788330383.917996:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 136 00000100:00100000:3.0:1788330383.918009:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+11:15040:x1875199766160512:12345-192.168.202.50@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788330383.918268:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+11:15040:x1875199766160512:12345-192.168.202.50@tcp:501:mount.lustre.0 Request processed in 261us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330383.918293:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 136 00000100:00100000:2.0:1788330383.927084:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330383.931008:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766160640 00000100:00100000:1.0:1788330383.931054:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766160640 00000100:00100000:1.0:1788330383.931236:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 137 00000100:00100000:1.0:1788330383.931251:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+11:15040:x1875199766160640:12345-192.168.202.50@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788330383.931459:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+11:15040:x1875199766160640:12345-192.168.202.50@tcp:503:mount.lustre.0 Request processed in 210us (4390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330383.931469:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 137 00000100:00100000:2.0:1788330383.949701:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330383.950233:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766160768 00000100:00100000:3.0:1788330383.950247:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766160768 00000100:00100000:3.0:1788330383.950323:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 138 00000100:00100000:3.0:1788330383.950335:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+11:15045:x1875199766160768:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788330383.950560:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+11:15045:x1875199766160768:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 216us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330383.950569:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 138 00010000:00010000:3.0:1788330383.965319:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330383.997992:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330384.002205:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766160896 00000100:00100000:1.0:1788330384.002231:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766160896 00000100:00100000:1.0:1788330384.002329:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 139 00000100:00100000:1.0:1788330384.002344:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+11:15045:x1875199766160896:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788330384.002931:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+11:15045:x1875199766160896:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 587us (4950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330384.002942:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 139 00000100:00100000:2.0:1788330384.010344:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330384.010461:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766161024 00000100:00100000:0.0:1788330384.010486:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766161024 00000100:00100000:0.0:1788330384.010670:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 140 00000100:00100000:0.0:1788330384.010685:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+11:15045:x1875199766161024:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788330384.010922:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+11:15045:x1875199766161024:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 240us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330384.010932:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 140 00000100:00100000:2.0:1788330384.015259:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330384.015416:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766161152 00000100:00100000:0.0:1788330384.015432:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766161152 00000100:00100000:0.0:1788330384.015557:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 141 00000100:00100000:0.0:1788330384.015568:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+11:15040:x1875199766161152:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788330384.016864:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330384.016895:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef6e78600/0x8475908e9fd2510 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610627f expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330384.016969:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e78600/0x8475908e9fd2510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610627f expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330384.016979:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef6e78600/0x8475908e9fd2510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610627f expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330384.016987:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78600, rc 0) 00000100:00100000:0.0:1788330384.017054:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+12:15040:x1875199766161152:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 1489us (1805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330384.017060:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 141 00000100:00100000:2.0:1788330384.020252:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330384.020350:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766161280 00000100:00100000:0.0:1788330384.020361:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766161280 00000100:00100000:0.0:1788330384.020422:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 142 00000100:00100000:0.0:1788330384.020433:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+12:15040:x1875199766161280:12345-192.168.202.50@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788330384.020481:0:17095:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788330384.020515:0:17095:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788330384.020521:0:17095:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788330384.020524:0:17095:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788330384.020528:0:17095:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788330384.020531:0:17095:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788330384.023181:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+12:15040:x1875199766161280:12345-192.168.202.50@tcp:256:mount.lustre.0 Request processed in 2710us (2898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330384.023196:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 142 00000100:00100000:2.0:1788330384.026046:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330384.026185:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766161408 00000100:00100000:0.0:1788330384.026197:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766161408 00000100:00100000:0.0:1788330384.026258:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 143 00000100:00100000:0.0:1788330384.026269:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+12:15040:x1875199766161408:12345-192.168.202.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788330384.026287:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330384.026306:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef6e78800/0x8475908e9fd2517 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106286 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330384.026340:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e78800/0x8475908e9fd2517 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106286 expref: 13 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330384.026351:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef6e78800/0x8475908e9fd2517 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106286 expref: 13 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330384.026362:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78800, rc 0) 00000100:00100000:0.0:1788330384.026428:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:15040:x1875199766161408:12345-192.168.202.50@tcp:101:mount.lustre.0 Request processed in 161us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330384.026435:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 143 00000100:00100000:2.0:1788330384.029182:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330384.029470:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766161536 00000100:00100000:0.0:1788330384.029505:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766161536 00000100:00100000:0.0:1788330384.029572:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 144 00000100:00100000:0.0:1788330384.029690:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:15040:x1875199766161536:12345-192.168.202.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788330384.030061:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:15040:x1875199766161536:12345-192.168.202.50@tcp:501:mount.lustre.0 Request processed in 480us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330384.030067:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 144 00000100:00100000:2.0:1788330384.034889:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330384.034997:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766161664 00000100:00100000:3.0:1788330384.035010:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766161664 00000100:00100000:3.0:1788330384.035082:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 145 00000100:00100000:3.0:1788330384.035096:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec908c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:15040:x1875199766161664:12345-192.168.202.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788330384.035341:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec908c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:15040:x1875199766161664:12345-192.168.202.50@tcp:503:mount.lustre.0 Request processed in 246us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330384.035350:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 145 00000100:00100000:2.0:1788330384.049539:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330384.049732:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766161792 00000100:00100000:0.0:1788330384.049743:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766161792 00000100:00100000:0.0:1788330384.049798:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 146 00000100:00100000:0.0:1788330384.049809:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec908d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:15048:x1875199766161792:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788330384.050078:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec908d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:15048:x1875199766161792:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 269us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330384.050086:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 146 00000100:00100000:1.0:1788330384.059362:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330384.059489:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766161920 00000100:00100000:2.0:1788330384.059502:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766161920 00000100:00100000:2.0:1788330384.059578:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 147 00000100:00100000:2.0:1788330384.059590:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:15048:x1875199766161920:12345-192.168.202.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788330384.059797:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:15048:x1875199766161920:12345-192.168.202.50@tcp:502:llog_process_th.0 Request processed in 209us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330384.059807:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 147 00000100:00100000:2.0:1788330384.078117:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330384.078575:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766162048 00000100:00100000:1.0:1788330384.078596:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766162048 00000100:00100000:1.0:1788330384.078656:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:1.0:1788330384.078666:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2409:x1875199766162048:12345-192.168.202.50@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788330384.078702:0:17104:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 14374cd5-fe9e-406e-8acf-b98a60f93e29@192.168.202.50@tcp t0 exp 0000000000000000 cur 588 last 0 00000020:00000080:1.0:1788330384.078890:0:17104:0:(genops.c:1385:class_connect()) connect: client 14374cd5-fe9e-406e-8acf-b98a60f93e29, cookie 0x8475908e9fd251e 00000004:00100000:1.0:1788330384.078918:0:17104:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788330384.079038:0:17104:0:(import.c:65:import_set_state_nolock()) ffff99edc5da0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788330384.079128:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:2409:x1875199766162048:12345-192.168.202.50@tcp:38:mount.lustre.0 Request processed in 461us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330384.079138:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:2.0:1788330384.087981:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330384.088633:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766162304 00000100:00100000:0.0:1788330384.088645:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766162304 00000100:00100000:0.0:1788330384.088706:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:0.0:1788330384.088725:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2409:x1875199766162304:12345-192.168.202.50@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788330384.088765:0:17103:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 14374cd5-fe9e-406e-8acf-b98a60f93e29@192.168.202.50@tcp t0 exp 0000000000000000 cur 588 last 0 00000020:00000080:0.0:1788330384.088838:0:17103:0:(genops.c:1385:class_connect()) connect: client 14374cd5-fe9e-406e-8acf-b98a60f93e29, cookie 0x8475908e9fd2525 00000004:00100000:0.0:1788330384.088868:0:17103:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788330384.088987:0:17103:0:(import.c:65:import_set_state_nolock()) ffff99eeded7e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330384.089070:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:2409:x1875199766162304:12345-192.168.202.50@tcp:38:mount.lustre.0 Request processed in 344us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330384.089078:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:2.0:1788330384.095891:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330384.097476:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766162560 00000100:00100000:3.0:1788330384.097490:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766162560 00000100:00100000:3.0:1788330384.097650:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:3.0:1788330384.097662:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:15040:x1875199766162560:12345-192.168.202.50@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788330384.097705:0:17105:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788330384.097804:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:15040:x1875199766162560:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 145us (1925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330384.097812:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00080000:0.0:1788330384.100654:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330384.107232:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330384.107284:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330384.107414:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766162176 00000100:00100000:0.0:1788330384.107426:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766162176 00000100:00100000:0.0:1788330384.107493:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766162688 00000100:00100000:0.0:1788330384.107496:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766162688 00000100:00100000:0.0:1788330384.107536:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:0.0:1788330384.107563:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+7:0:x1875199766162176:12345-192.168.202.50@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788330384.107603:0:17103:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788330384.107686:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+7:0:x1875199766162176:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 126us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330384.107695:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:0.0:1788330384.107716:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:0.0:1788330384.107722:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:15040:x1875199766162688:12345-192.168.202.50@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788330384.107768:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:15040:x1875199766162688:12345-192.168.202.50@tcp:40:mount.lustre.0 Request processed in 46us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330384.107774:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:0.0:1788330384.107869:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330384.107913:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766162432 00000100:00100000:3.0:1788330384.107919:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766162432 00000100:00100000:3.0:1788330384.107967:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:3.0:1788330384.107974:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:0:x1875199766162432:12345-192.168.202.50@tcp:41:mount.lustre.0 00000100:00080000:0.0:1788330384.107980:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:3.0:1788330384.107995:0:17103:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788330384.108043:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:0:x1875199766162432:12345-192.168.202.50@tcp:41:mount.lustre.0 Request processed in 69us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330384.108050:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:0.0:1788330384.121997:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330384.122060:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330384.122190:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766162816 00000100:00100000:1.0:1788330384.122203:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766162816 00000100:00100000:1.0:1788330384.122261:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766162944 00000100:00100000:1.0:1788330384.122265:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766162944 00000100:00100000:1.0:1788330384.122419:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:1.0:1788330384.122429:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2409:x1875199766162816:12345-192.168.202.50@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788330384.122471:0:18612:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 14374cd5-fe9e-406e-8acf-b98a60f93e29@192.168.202.50@tcp t0 exp 0000000000000000 cur 588 last 0 00000020:00000080:1.0:1788330384.122511:0:18612:0:(genops.c:1385:class_connect()) connect: client 14374cd5-fe9e-406e-8acf-b98a60f93e29, cookie 0x8475908e9fd252c 00002000:00100000:1.0:1788330384.122527:0:18612:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 14374cd5-fe9e-406e-8acf-b98a60f93e29/ffff99edc5da7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788330384.122556:0:18612:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788330384.122660:0:18612:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788330384.122699:0:18612:0:(import.c:65:import_set_state_nolock()) ffff99edc5da5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788330384.122801:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:2409:x1875199766162816:12345-192.168.202.50@tcp:8:mount.lustre.0 Request processed in 372us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330384.122810:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:1.0:1788330384.122832:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00100000:1.0:1788330384.122837:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2409:x1875199766162944:12345-192.168.202.50@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788330384.122855:0:18612:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 14374cd5-fe9e-406e-8acf-b98a60f93e29@192.168.202.50@tcp t0 exp 0000000000000000 cur 588 last 0 00000020:00000080:1.0:1788330384.122876:0:18612:0:(genops.c:1385:class_connect()) connect: client 14374cd5-fe9e-406e-8acf-b98a60f93e29, cookie 0x8475908e9fd2533 00002000:00100000:1.0:1788330384.122883:0:18612:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 14374cd5-fe9e-406e-8acf-b98a60f93e29/ffff99edc5da6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788330384.122890:0:18612:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788330384.122937:0:18612:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788330384.122953:0:18612:0:(import.c:65:import_set_state_nolock()) ffff99edc5da0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788330384.122979:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:2409:x1875199766162944:12345-192.168.202.50@tcp:8:mount.lustre.0 Request processed in 141us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330384.123006:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00100000:3.0:1788330384.125765:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330384.125918:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766163072 00000100:00100000:2.0:1788330384.125930:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766163072 00000100:00100000:2.0:1788330384.126012:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:2.0:1788330384.126024:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:15040:x1875199766163072:12345-192.168.202.50@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788330384.126112:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:15040:x1875199766163072:12345-192.168.202.50@tcp:900:mount.lustre.0 Request processed in 90us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330384.126120:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:2.0:1788330384.136894:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330384.137380:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766163200 00000100:00100000:0.0:1788330384.137393:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766163200 00000100:00100000:0.0:1788330384.137461:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:0.0:1788330384.137474:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:15040:x1875199766163200:12345-192.168.202.50@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788330384.137592:0:17107:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788330384.137696:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:15040:x1875199766163200:12345-192.168.202.50@tcp:33:mount.lustre.0 Request processed in 223us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330384.137728:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:0.0:1788330384.379255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330384.379360:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766163328 00000100:00100000:3.0:1788330384.379372:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766163328 00000100:00100000:3.0:1788330384.379444:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 22 00000100:00100000:3.0:1788330384.379457:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:15071:x1875199766163328:12345-192.168.202.50@tcp:101:mkdir.0 00010000:00010000:3.0:1788330384.379485:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330384.379526:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b600/0x8475908e9fd253a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61062b7 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330384.379632:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b000/0x8475908e9fd2541 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330384.379644:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b000/0x8475908e9fd2541 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330384.379655:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b000/0x8475908e9fd2541 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330384.379698:0:17103:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788330384.379701:0:17103:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788330384.379721:0:17103:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b000/0x8475908e9fd2541 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330384.379768:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b600/0x8475908e9fd253a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062b7 expref: 8 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330384.379789:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b000/0x8475908e9fd2541 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062b7 expref: 7 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330384.379798:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99edc10b5000) 00010000:00010000:3.0:1788330384.379801:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330384.379805:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eeef91b000, rc 0) 00000100:00100000:3.0:1788330384.379868:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+7:15071:x1875199766163328:12345-192.168.202.50@tcp:101:mkdir.0 Request processed in 415us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330384.379873:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 22 00010000:00010000:1.0:1788330384.991240:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330386.022894:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330386.331883:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788330386.331908:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792468992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330386.332030:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330386.332143:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792468992 00000100:00100000:0.0:1788330386.332193:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792468992 00000100:00100000:0.0:1788330386.332670:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788330386.332685:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792468992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788330386.332787:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788330386.332845:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792468992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330386.332853:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788330386.332905:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792468992:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788330386.333071:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330386.844044:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792469248:0@lo:400:kworker.0 00000100:00100000:1.0:1788330386.844351:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330386.844422:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792469760:0@lo:400:kworker.0 00000100:00100000:1.0:1788330386.844454:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330386.844474:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792470272:0@lo:400:kworker.0 00000100:00100000:1.0:1788330386.844637:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330386.844671:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788330386.844678:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792469376:0@lo:400:kworker.0 00000100:00100000:3.0:1788330386.846024:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792469248 00000100:00100000:3.0:1788330386.846037:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792469248 00000100:00100000:3.0:1788330386.846095:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788330386.846105:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:3648:x1875199792469248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330386.846275:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330386.846319:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792469888:0@lo:400:kworker.0 00000100:00100000:1.0:1788330386.846348:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330386.846368:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792470400:0@lo:400:kworker.0 00000100:00100000:1.0:1788330386.846392:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330386.846425:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792470272 00000100:00100000:1.0:1788330386.846429:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792470272 00000100:00100000:1.0:1788330386.846465:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792470400 00000100:00100000:1.0:1788330386.846469:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792470400 00000100:00100000:3.0:1788330386.846656:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:3648:x1875199792469248:12345-0@lo:400:kworker.0 Request processed in 551us (2505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330386.846664:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788330386.847674:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792469120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330386.847823:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792469504:0@lo:400:kworker.0 00000100:00100000:2.0:1788330386.847864:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330386.847889:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792470016:0@lo:400:kworker.0 00000100:00100000:2.0:1788330386.847911:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330386.848017:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330386.848037:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792469632:0@lo:400:kworker.0 00000100:00100000:0.0:1788330386.848064:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330386.848281:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792470528:0@lo:400:kworker.0 00000100:00100000:2.0:1788330386.848328:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792469760 00000100:00100000:2.0:1788330386.848335:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792469760 00000100:00100000:2.0:1788330386.848373:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792469376 00000100:00100000:2.0:1788330386.848376:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792469376 00000100:00100000:2.0:1788330386.848392:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788330386.848400:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792469760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330386.848449:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792469760:12345-0@lo:400:kworker.0 Request processed in 49us (3994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330386.848457:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788330386.848473:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788330386.848479:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792469376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330386.848720:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792469376:12345-0@lo:400:kworker.0 Request processed in 241us (2445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330386.848727:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788330386.848759:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792469888 00000100:00100000:2.0:1788330386.848764:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792469888 00000100:00100000:2.0:1788330386.848792:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792469504 00000100:00100000:2.0:1788330386.848794:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792469504 00000100:00100000:2.0:1788330386.848804:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792470016 00000100:00100000:2.0:1788330386.848806:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792470016 00000100:00100000:2.0:1788330386.848818:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788330386.848824:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792469888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330386.848855:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792469888:12345-0@lo:400:kworker.0 Request processed in 31us (2506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330386.848861:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788330386.848871:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788330386.848876:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792469504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330386.848901:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792469504:12345-0@lo:400:kworker.0 Request processed in 26us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330386.848907:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788330386.848916:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788330386.848921:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eededaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792470016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330386.850126:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792470144:0@lo:400:kworker.0 00000100:00100000:0.0:1788330386.850180:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330386.850247:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eededaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792470016:12345-0@lo:400:kworker.0 Request processed in 1325us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330386.850256:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788330386.856912:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792469632 00000100:00100000:1.0:1788330386.862379:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792469632 00000100:00100000:1.0:1788330386.862476:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788330386.862502:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792470272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330386.862629:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875199792470272:12345-0@lo:400:kworker.0 Request processed in 142us (17991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330386.862650:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788330386.862668:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788330386.862675:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792470400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330386.862720:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792470400:12345-0@lo:400:kworker.0 Request processed in 46us (16327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330386.862726:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788330386.862738:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788330386.862744:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792469632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330386.862775:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792469632:12345-0@lo:400:kworker.0 Request processed in 32us (14711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330386.862781:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788330386.863134:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788330386.863141:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788330386.863145:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788330386.863175:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330386.863233:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792469376:0@lo:400:kworker.0 00000100:00100000:1.0:1788330386.863249:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792469888:0@lo:400:kworker.0 00010000:00080000:1.0:1788330386.863263:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc8451880 x1875199792470400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330386.863275:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792470400:0@lo:400:kworker.0 00000100:00100000:1.0:1788330386.863287:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3648:1875199792469248:0@lo:400:kworker.0 00000100:00100000:1.0:1788330386.863300:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792469760:0@lo:400:kworker.0 00000100:00100000:1.0:1788330386.863310:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875199792470272:0@lo:400:kworker.0 00000100:00100000:1.0:1788330386.863481:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792469120 00000100:00100000:1.0:1788330386.863488:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792469120 00000100:00100000:1.0:1788330386.863541:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788330386.863549:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792469120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330386.863575:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788330386.863624:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792469120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (15607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330386.863631:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788330386.863819:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792470144 00000100:00100000:0.0:1788330386.863824:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792470144 00000100:00100000:0.0:1788330386.863853:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788330386.863861:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792470144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330386.863893:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792470144:12345-0@lo:400:kworker.0 Request processed in 33us (13713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330386.863898:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788330386.864079:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792470144:0@lo:400:kworker.0 00000100:00100000:0.0:1788330386.864092:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792470656:0@lo:400:kworker.0 00000100:00100000:0.0:1788330386.864131:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330386.864169:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792470656 00000100:00100000:0.0:1788330386.864173:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792470656 00000100:00100000:0.0:1788330386.864207:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788330386.864212:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792470656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330386.864240:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792470656:12345-0@lo:400:kworker.0 Request processed in 28us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330386.864245:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788330386.864261:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788330386.864279:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc6607b80 x1875199792470656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330386.864288:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792470656:0@lo:400:kworker.0 00000100:00100000:0.0:1788330386.864312:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788330386.864329:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792469120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330386.864343:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792469632:0@lo:400:kworker.0 00000100:00100000:0.0:1788330386.864382:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330386.864414:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792469504:0@lo:400:kworker.0 00000100:00100000:0.0:1788330386.864426:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792470016:0@lo:400:kworker.0 00000100:00100000:0.0:1788330386.864448:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792470528 00000100:00100000:0.0:1788330386.864452:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792470528 00000100:00100000:0.0:1788330386.864477:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788330386.864483:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792470528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330386.864537:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875199792470528:12345-0@lo:400:kworker.0 Request processed in 54us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330386.864544:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788330386.864558:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330386.864578:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875199792470528:0@lo:400:kworker.0 00000100:00100000:1.0:1788330386.865199:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330386.865214:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6606300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792470784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788330386.865248:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330386.865286:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792470784 00000100:00100000:1.0:1788330386.865289:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792470784 00000100:00100000:1.0:1788330386.865311:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788330386.865319:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792470784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788330386.865334:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788330386.865373:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792470784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330386.865380:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788330386.865412:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6606300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792470784:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1788330386.875683:0:17083:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 14374cd5-fe9e-406e-8acf-b98a60f93e29 00000001:00100000:1.0:1788330386.875706:0:17083:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 99dd523a-1cb7-4908-afb4-ee09ad740fbd 00000001:00100000:0.0:1788330386.881234:0:18607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 14374cd5-fe9e-406e-8acf-b98a60f93e29 00000001:00100000:0.0:1788330386.881255:0:18607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99dd523a-1cb7-4908-afb4-ee09ad740fbd 00000001:00100000:1.0:1788330386.881305:0:17837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 14374cd5-fe9e-406e-8acf-b98a60f93e29 00000001:00100000:1.0:1788330386.881312:0:17837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 99dd523a-1cb7-4908-afb4-ee09ad740fbd 00010000:00010000:3.0:1788330387.038017:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330387.355580:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792470912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330387.355672:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330387.355872:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792470912 00000100:00100000:3.0:1788330387.355881:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792470912 00000100:00100000:3.0:1788330387.355948:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788330387.355958:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792470912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788330387.355981:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788330387.364069:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792470912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8101us (8385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330387.364084:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788330387.364617:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792470912:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788330387.486846:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788330388.063123:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788330388.086901:0:19984:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788330388.379587:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792471040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788330388.379673:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330388.379938:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792471168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330388.379970:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330388.380181:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792471040 00000100:00100000:0.0:1788330388.380190:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792471040 00000100:00100000:0.0:1788330388.380253:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792471168 00000100:00100000:0.0:1788330388.380255:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792471168 00000100:00100000:0.0:1788330388.380272:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788330388.380281:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792471040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788330388.380336:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788330388.380385:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792471040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330388.380392:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788330388.380414:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788330388.380420:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792471168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788330388.380437:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788330388.380466:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792471168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330388.380472:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788330388.382242:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7db3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792471040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330388.382369:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792471168:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788330389.083408:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330389.223856:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330389.223906:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330389.223935:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330389.223967:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330389.223986:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330389.224004:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330389.224019:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330389.224038:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330389.224064:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330389.224109:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766163712 00000100:00100000:3.0:1788330389.224120:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766163712 00000100:00100000:3.0:1788330389.224198:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766164224 00000100:00100000:3.0:1788330389.224202:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766164224 00000100:00100000:3.0:1788330389.224215:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766163584 00000100:00100000:3.0:1788330389.224217:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766163584 00000100:00100000:3.0:1788330389.224230:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766164096 00000100:00100000:3.0:1788330389.224232:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766164096 00000100:00100000:3.0:1788330389.224247:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:3.0:1788330389.224257:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2413:x1875199766163712:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330389.224341:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2413:x1875199766163712:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 84us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330389.224360:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:3.0:1788330389.224378:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:3.0:1788330389.224384:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2413:x1875199766164224:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330389.224410:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2413:x1875199766164224:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 26us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330389.224416:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:3.0:1788330389.224426:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 54 00000100:00100000:3.0:1788330389.224431:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:2413:x1875199766163584:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330389.224451:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:2413:x1875199766163584:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 20us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330389.224457:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 54 00000100:00100000:3.0:1788330389.224466:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00100000:3.0:1788330389.224471:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:2413:x1875199766164096:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330389.224490:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:2413:x1875199766164096:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 19us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330389.224505:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00100000:3.0:1788330389.224529:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766163968 00000100:00100000:3.0:1788330389.224729:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766163968 00000100:00100000:3.0:1788330389.224758:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766164480 00000100:00100000:3.0:1788330389.224761:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766164480 00000100:00100000:3.0:1788330389.224771:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766163840 00000100:00100000:3.0:1788330389.224773:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766163840 00000100:00100000:3.0:1788330389.224783:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766164352 00000100:00100000:3.0:1788330389.224786:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766164352 00000100:00100000:3.0:1788330389.224798:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:3.0:1788330389.224813:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2413:x1875199766163968:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330389.224843:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2413:x1875199766163968:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 31us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330389.224849:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 12 00000100:00100000:3.0:1788330389.224861:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:3.0:1788330389.224868:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:2413:x1875199766164480:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330389.224891:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:2413:x1875199766164480:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 23us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330389.224897:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 13 00000100:00100000:3.0:1788330389.224908:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:3.0:1788330389.224914:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2413:x1875199766163840:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330389.224937:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2413:x1875199766163840:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 23us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330389.224944:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 14 00000100:00100000:3.0:1788330389.225658:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:3.0:1788330389.225669:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2413:x1875199766164352:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330389.225705:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2413:x1875199766164352:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 39us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330389.225711:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00080000:3.0:1788330389.225747:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330389.225752:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330389.225756:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788330389.225759:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788330389.226835:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766163456 00000100:00100000:2.0:1788330389.226848:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766163456 00000100:00100000:2.0:1788330389.226907:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 149 00000100:00100000:2.0:1788330389.226917:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:2413:x1875199766163456:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330389.226982:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:2413:x1875199766163456:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 66us (3138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330389.226996:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 149 00000001:00100000:3.0:1788330389.924406:0:19426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 14374cd5-fe9e-406e-8acf-b98a60f93e29 00010000:00010000:1.0:1788330390.109771:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330391.133776:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330391.451400:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330391.451432:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792471296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330391.451549:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330391.451980:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792471296 00000100:00100000:0.0:1788330391.451992:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792471296 00000100:00100000:0.0:1788330391.452073:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788330391.452088:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792471296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788330391.452127:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788330391.452204:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792471296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330391.452212:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788330391.452356:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330391.452424:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6606680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792471296:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1788330391.668399:0:20131:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb5ad6b80 20000000:00000080:0.0:1788330391.668426:0:20131:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99eefcdb9400 uarg=0000000000000000 20000000:01000000:0.0:1788330391.668506:0:20131:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788330391.668515:0:20131:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788330391.668521:0:20131:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788330391.671214:0:20132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1788330391.671827:0:20131:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788330391.685283:0:20131:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788330391.685335:0:20131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99eec9039400/0x8475908e9fd2548 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330391.685365:0:20131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eeef91bc00/0x8475908e9fd21dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd21d6 expref: 23 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330391.685375:0:20131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eec9038e00/0x8475908e9fd21eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd21e4 expref: 23 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330391.685383:0:20131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eeef91b800/0x8475908e9fd222a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2223 expref: 23 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330391.685391:0:20131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eefe7ee800/0x8475908e9fd238f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2388 expref: 23 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330391.685404:0:20131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eec9038800/0x8475908e9fd24d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106216 expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330391.685413:0:20131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99eef6e78800/0x8475908e9fd2517 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106286 expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330391.685423:0:20131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99eec9039400/0x8475908e9fd2548 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330391.685517:0:20131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eef6e78800/0x8475908e9fd2517 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106286 expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330391.685559:0:20131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eef6e78800/0x8475908e9fd2517 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106286 expref: 12 pid: 17097 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330391.685580:0:20131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20131:1875199792471424:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330391.685752:0:20131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eec9038800/0x8475908e9fd24d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106216 expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330391.685762:0:20131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eec9038800/0x8475908e9fd24d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106216 expref: 12 pid: 17097 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330391.685772:0:20131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20131:1875199792471552:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330391.685804:0:20131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eefe7ee800/0x8475908e9fd238f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd2388 expref: 23 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330391.685812:0:20131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eefe7ee800/0x8475908e9fd238f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd2388 expref: 23 pid: 17098 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330391.685823:0:20131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc75fce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20131:1875199792471680:0@lo:104: 00000100:00100000:2.0:1788330391.685869:0:20131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330391.685914:0:20131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eeef91b800/0x8475908e9fd222a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd2223 expref: 23 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330391.686082:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792471680 00000100:00100000:1.0:1788330391.686093:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792471680 00000100:00100000:1.0:1788330391.686190:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788330391.686203:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+3:20131:x1875199792471680:12345-0@lo:104: 00010000:00010000:1.0:1788330391.686219:0:17086:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eefe7eea00/0x8475908e9fd2388 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd238f expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330391.686307:0:17086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788330391.686314:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+3:20131:x1875199792471680:12345-0@lo:104: Request processed in 115us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330391.686323:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788330391.686472:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330391.686492:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eefe7eea00/0x8475908e9fd2388 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd238f expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.686501:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7eea00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330391.686506:0:17858:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eefe7eea00/0x8475908e9fd2388 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd238f expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.686516:0:17858:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eefe7eea00/0x8475908e9fd2388 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd238f expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330391.686524:0:17858:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eefe7eea00/0x8475908e9fd2388 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd238f expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330391.686546:0:17858:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788330391.686595:0:17858:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eefe7eea00/0x8475908e9fd2388 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd238f expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.686603:0:17858:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330391.686637:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eefe7eea00/0x8475908e9fd2388 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd238f expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.686645:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eefe7eea00/0x8475908e9fd2388 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd238f expref: -99 pid: 19425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.686660:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330391.686661:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330391.686663:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330391.686681:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3649:1875199792471936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330391.686719:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330391.686762:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792471936 00000100:00100000:0.0:1788330391.686767:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792471936 00010000:00010000:0.0:1788330391.686789:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eefe7ee800/0x8475908e9fd238f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2388 expref: 24 pid: 17098 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330391.686813:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788330391.686820:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:3649:x1875199792471936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330391.686833:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330391.686838:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eefe7ee800/0x8475908e9fd238f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2388 expref: 24 pid: 17098 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330391.689405:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330391.689490:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330391.689531:0:19442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766164608 00000100:00100000:3.0:1788330391.689543:0:19442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766164608 00010000:00010000:3.0:1788330391.689592:0:19442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eef6e78800/0x8475908e9fd2517 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106286 expref: 13 pid: 17097 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330391.689631:0:19442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766164736 00000100:00100000:3.0:1788330391.689634:0:19442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766164736 00010000:00010000:3.0:1788330391.689659:0:19442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eec9038800/0x8475908e9fd24d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106216 expref: 14 pid: 17097 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330391.689676:0:19442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:3.0:1788330391.689686:0:19442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+14:2413:x1875199766164608:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330391.689815:0:20131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eeef91b800/0x8475908e9fd222a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd2223 expref: 24 pid: 17098 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330391.689838:0:20131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8450380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20131:1875199792471808:0@lo:104: 00000100:00100000:2.0:1788330391.689900:0:20131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788330391.690354:0:19442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330391.690365:0:19442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eef6e78800/0x8475908e9fd2517 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106286 expref: 14 pid: 17097 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330391.690453:0:17090:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788330391.690466:0:17090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1788330391.690833:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:1.0:1788330391.690844:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+14:2413:x1875199766164736:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330391.690867:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330391.690872:0:17090:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eec9038800/0x8475908e9fd24d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106216 expref: 14 pid: 17097 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.691741:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eefe7ee800/0x8475908e9fd238f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd2388 expref: 24 pid: 17098 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.691786:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330391.691858:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792471808 00000100:00100000:0.0:1788330391.691867:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792471808 00000100:00100000:0.0:1788330391.692067:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788330391.692076:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8453800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+3:20131:x1875199792471808:12345-0@lo:104: 00010000:00010000:0.0:1788330391.692094:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eeef91aa00/0x8475908e9fd2223 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd222a expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.692214:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788330391.692221:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8453800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+3:20131:x1875199792471808:12345-0@lo:104: Request processed in 146us (2320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330391.692229:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788330391.692261:0:17091:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330391.692268:0:17091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eeef91aa00/0x8475908e9fd2223 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd222a expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.692279:0:17091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91aa00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330391.692285:0:17091:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eeef91aa00/0x8475908e9fd2223 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd222a expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.692295:0:17091:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eeef91aa00/0x8475908e9fd2223 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd222a expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330391.692303:0:17091:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eeef91aa00/0x8475908e9fd2223 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd222a expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330391.692310:0:17091:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788330391.692356:0:17091:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eeef91aa00/0x8475908e9fd2223 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd222a expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.692370:0:17091:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330391.692400:0:17091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eeef91aa00/0x8475908e9fd2223 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd222a expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.692408:0:17091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eeef91aa00/0x8475908e9fd2223 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd222a expref: -99 pid: 18605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.692424:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330391.692426:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330391.692428:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330391.692457:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792472064:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330391.693039:0:20131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eec9038e00/0x8475908e9fd21eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd21e4 expref: 24 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330391.693054:0:20131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eec9038e00/0x8475908e9fd21eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd21e4 expref: 24 pid: 17098 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330391.693060:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330391.693067:0:20131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20131:1875199792472192:0@lo:104: 00000100:00100000:2.0:1788330391.693093:0:20131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330391.693121:0:20131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99eeef91bc00/0x8475908e9fd21dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8475908e9fd21d6 expref: 24 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330391.693121:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792472192 00000100:00100000:0.0:1788330391.693128:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792472192 00010000:00010000:2.0:1788330391.693129:0:20131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99eeef91bc00/0x8475908e9fd21dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8475908e9fd21d6 expref: 24 pid: 17097 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330391.693137:0:20131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20131:1875199792472320:0@lo:104: 00000100:00100000:2.0:1788330391.693172:0:20131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330391.693172:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788330391.693181:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8451c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+3:20131:x1875199792472192:12345-0@lo:104: 00000100:00100000:2.0:1788330391.693183:0:20131:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc10a5180 going to sleep for 11 seconds 00010000:00010000:0.0:1788330391.693190:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eeef91ac00/0x8475908e9fd21e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd21eb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330391.693211:0:20131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eee7640000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20131:1875199792471424:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330391.693223:0:20131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20131:1875199792471552:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330391.693227:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788330391.693232:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8451c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+3:20131:x1875199792472192:12345-0@lo:104: Request processed in 53us (138us total) trans 0 rc 0/0 00010000:00010000:2.0:1788330391.693234:0:20131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eefe7ee800/0x8475908e9fd238f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd2388 expref: 24 pid: 17098 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330391.693239:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788330391.693246:0:20131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc75fce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20131:1875199792471680:0@lo:104: 00000100:00100000:0.0:1788330391.693253:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792472320 00000100:00100000:2.0:1788330391.693254:0:20131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8450380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20131:1875199792471808:0@lo:104: 00000100:00100000:0.0:1788330391.693256:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792472320 00000100:00100000:2.0:1788330391.693261:0:20131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20131:1875199792472192:0@lo:104: 00000100:00100000:0.0:1788330391.693268:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788330391.693273:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8452a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+3:20131:x1875199792472320:12345-0@lo:104: 00010000:00010000:0.0:1788330391.693290:0:17087:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.150@tcp lock: ffff99eec9038000/0x8475908e9fd21d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd21dd expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.693341:0:17087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788330391.693346:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8452a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+3:20131:x1875199792472320:12345-0@lo:104: Request processed in 73us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330391.693352:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788330391.693382:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788330391.693387:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eeef91ac00/0x8475908e9fd21e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd21eb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330391.693388:0:20131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20131:1875199792472320:0@lo:104: 00010000:00010000:0.0:1788330391.693394:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91ac00 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330391.693397:0:17858:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eeef91ac00/0x8475908e9fd21e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd21eb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.693405:0:17858:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eeef91ac00/0x8475908e9fd21e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd21eb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330391.693411:0:17858:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eeef91ac00/0x8475908e9fd21e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd21eb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330391.693416:0:17858:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788330391.693423:0:20131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99eec9039400/0x8475908e9fd2548 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.693440:0:17858:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eeef91ac00/0x8475908e9fd21e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd21eb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.693445:0:17858:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788330391.693590:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3647:1875199792472448:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330391.693600:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eeef91ac00/0x8475908e9fd21e4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd21eb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.693608:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eeef91ac00/0x8475908e9fd21e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd21eb expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330391.693626:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330391.693627:0:17858:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330391.693630:0:17858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.150@tcp lock: ffff99eec9038000/0x8475908e9fd21d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8475908e9fd21dd expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.693636:0:17858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038000 already unused, calling callback (ffffffffc14efc20) 10000000:00010000:0.0:1788330391.693639:0:17858:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.150@tcp lock: ffff99eec9038000/0x8475908e9fd21d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8475908e9fd21dd expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.693646:0:17858:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.150@tcp lock: ffff99eec9038000/0x8475908e9fd21d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8475908e9fd21dd expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330391.693652:0:17858:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.150@tcp lock: ffff99eec9038000/0x8475908e9fd21d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8475908e9fd21dd expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330391.693658:0:17858:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788330391.693673:0:17858:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.150@tcp lock: ffff99eec9038000/0x8475908e9fd21d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd21dd expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.693680:0:17858:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330391.693707:0:17858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.150@tcp lock: ffff99eec9038000/0x8475908e9fd21d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd21dd expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.693714:0:17858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.150@tcp lock: ffff99eec9038000/0x8475908e9fd21d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8475908e9fd21dd expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330391.693737:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330391.693739:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330391.693740:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330391.693759:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330391.693776:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3649:1875199792472576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330391.693804:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788330391.693862:0:19442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eef6e78800/0x8475908e9fd2517 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106286 expref: 14 pid: 17097 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330391.693878:0:19442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eef6e78800/0x8475908e9fd2517 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106286 expref: 14 pid: 17097 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330391.693893:0:19442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330391.693970:0:19442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:2413:x1875199766164608:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 4284us (4578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330391.693979:0:19442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:3.0:1788330391.694009:0:19442:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788330391.694016:0:19442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792472064 00000100:00100000:3.0:1788330391.694020:0:19442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792472064 00010000:00010000:3.0:1788330391.694038:0:19442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eeef91b800/0x8475908e9fd222a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2223 expref: 24 pid: 17098 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330391.694049:0:19442:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788330391.694052:0:19442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792472448 00000100:00100000:3.0:1788330391.694054:0:19442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792472448 00010000:00010000:3.0:1788330391.694062:0:19442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eec9038e00/0x8475908e9fd21eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd21e4 expref: 25 pid: 17098 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330391.694070:0:19442:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788330391.694074:0:19442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792472576 00000100:00100000:3.0:1788330391.694076:0:19442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792472576 00010000:00010000:3.0:1788330391.694083:0:19442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99eeef91bc00/0x8475908e9fd21dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd21d6 expref: 26 pid: 17097 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330391.694092:0:19442:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788330391.694097:0:19442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788330391.694104:0:19442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+26:3646:x1875199792472064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330391.694113:0:19442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330391.694117:0:19442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eeef91b800/0x8475908e9fd222a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd2223 expref: 26 pid: 17098 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330391.694125:0:19442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eeef91b800/0x8475908e9fd222a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd2223 expref: 26 pid: 17098 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330391.694135:0:19442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eeef91b800/0x8475908e9fd222a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd2223 expref: 26 pid: 17098 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330391.694144:0:19442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330391.695267:0:19442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+25:3646:x1875199792472064:12345-0@lo:103:ldlm_bl.0 Request processed in 1157us (2201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330391.695280:0:19442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788330391.695307:0:19442:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788330391.695319:0:19442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788330391.695329:0:19442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed06a6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:3647:x1875199792472448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330391.695343:0:19442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330391.695350:0:19442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eec9038e00/0x8475908e9fd21eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd21e4 expref: 24 pid: 17098 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330391.695361:0:19442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eec9038e00/0x8475908e9fd21eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd21e4 expref: 24 pid: 17098 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330391.695377:0:19442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec9038e00/0x8475908e9fd21eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd21e4 expref: 24 pid: 17098 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330391.695388:0:19442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330391.695424:0:19442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed06a6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:3647:x1875199792472448:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (1798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330391.695431:0:19442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788330391.695442:0:19442:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788330391.695448:0:19442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788330391.695455:0:19442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:3649:x1875199792472576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330391.695463:0:19442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330391.695468:0:19442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99eeef91bc00/0x8475908e9fd21dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8475908e9fd21d6 expref: 22 pid: 17097 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330391.695487:0:19442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eeef91bc00/0x8475908e9fd21dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8475908e9fd21d6 expref: 22 pid: 17097 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330391.695522:0:19442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eeef91bc00/0x8475908e9fd21dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8475908e9fd21d6 expref: 22 pid: 17097 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330391.695532:0:19442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330391.695568:0:19442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:3649:x1875199792472576:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (1764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330391.695575:0:19442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1788330391.695601:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330391.695763:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3647:1875199792472448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330391.695986:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3649:1875199792472576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330391.696123:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792472064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330391.696299:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+20:3649:x1875199792471936:12345-0@lo:103:ldlm_bl.0 Request processed in 9478us (9578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330391.696308:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788330391.696520:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3649:1875199792471936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330391.699085:0:17090:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99eec9038800/0x8475908e9fd24d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106216 expref: 12 pid: 17097 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330391.699127:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec9038800/0x8475908e9fd24d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106216 expref: 12 pid: 17097 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330391.699166:0:17090:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99eec9039400/0x8475908e9fd2548 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330391.699177:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9039400/0x8475908e9fd2548 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330391.699207:0:17090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eec9039400/0x8475908e9fd2548 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330391.699215:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99eec9039400/0x8475908e9fd2548 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330391.699223:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99eec9039400/0x8475908e9fd2548 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330391.699231:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99eec9039400/0x8475908e9fd2548 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330391.699238:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330391.699244:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99eec9039400/0x8475908e9fd2548 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330391.699273:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99eec9039400/0x8475908e9fd2548 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330391.701647:0:20131:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99eec9039400/0x8475908e9fd2548 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330391.701675:0:20131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99eec9039400/0x8475908e9fd2548 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330391.703137:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99eec9039400/0x8475908e9fd2548 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330391.703178:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99eec9039400/0x8475908e9fd2548 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330391.703205:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330391.703313:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+11:2413:x1875199766164736:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 12463us (13814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330391.703326:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:3.0:1788330391.964789:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792472832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330391.964902:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330391.964966:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792472704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788330391.964992:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330391.965045:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792472832 00000100:00100000:3.0:1788330391.965056:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792472832 00000100:00100000:3.0:1788330391.965124:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792472704 00000100:00100000:3.0:1788330391.965128:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792472704 00000100:00100000:3.0:1788330391.965178:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788330391.965191:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792472832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330391.965248:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788330391.965319:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792472832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330391.965326:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788330391.965349:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788330391.965356:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7db0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792472704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788330391.965365:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788330391.965389:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7db0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792472704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330391.965395:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788330391.965415:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330391.965486:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6604380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792472832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330391.965504:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792472704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330391.966948:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792473088:0@lo:400:kworker.0 00000100:00100000:2.0:1788330391.967029:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330391.967064:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792473600:0@lo:400:kworker.0 00000100:00100000:2.0:1788330391.967086:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330391.967110:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788330391.967116:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792472960:0@lo:400:kworker.0 00000100:00100000:2.0:1788330391.967143:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330391.967186:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792473472:0@lo:400:kworker.0 00000100:00100000:2.0:1788330391.967207:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330391.967223:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792473984:0@lo:400:kworker.0 00000100:00100000:2.0:1788330391.967245:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330391.967342:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792473088 00000100:00100000:2.0:1788330391.967351:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792473088 00000100:00100000:2.0:1788330391.967394:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792473600 00000100:00100000:2.0:1788330391.967397:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792473600 00000100:00100000:2.0:1788330391.967503:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792473472 00000100:00100000:2.0:1788330391.967572:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792473472 00000100:00100000:2.0:1788330391.967591:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792473984 00000100:00100000:2.0:1788330391.967593:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792473984 00000100:00100000:2.0:1788330391.967629:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788330391.967640:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792473088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330391.967707:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875199792473088:12345-0@lo:400:kworker.0 Request processed in 69us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330391.967715:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788330391.967734:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788330391.967739:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc75fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792473600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330391.967762:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc75fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875199792473600:12345-0@lo:400:kworker.0 Request processed in 24us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330391.967767:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788330391.967776:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788330391.967781:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792473472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330391.967803:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875199792473472:12345-0@lo:400:kworker.0 Request processed in 22us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330391.967809:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788330391.967818:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788330391.967824:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792473984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330391.967849:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875199792473984:12345-0@lo:400:kworker.0 Request processed in 26us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330391.967854:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788330391.967878:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792473216:0@lo:400:kworker.0 00000100:00100000:2.0:1788330391.967908:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330391.967933:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792473728:0@lo:400:kworker.0 00000100:00100000:2.0:1788330391.967953:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330391.967973:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788330391.967988:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792473344:0@lo:400:kworker.0 00000100:00100000:2.0:1788330391.968017:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330391.968035:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792473856:0@lo:400:kworker.0 00000100:00100000:2.0:1788330391.968057:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330391.968102:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875199792473472:0@lo:400:kworker.0 00010000:00080000:2.0:1788330391.968117:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc8452680 x1875199792473984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330391.968128:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875199792473984:0@lo:400:kworker.0 00000100:00100000:2.0:1788330391.968139:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875199792473088:0@lo:400:kworker.0 00000100:00100000:2.0:1788330391.968173:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875199792473600:0@lo:400:kworker.0 00000100:00100000:2.0:1788330391.968205:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792473728 00000100:00100000:2.0:1788330391.968209:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792473728 00000100:00100000:2.0:1788330391.968230:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792473856 00000100:00100000:2.0:1788330391.968234:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792473856 00000100:00100000:2.0:1788330391.968248:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788330391.968253:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792473728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330391.968392:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792472960 00000100:00100000:0.0:1788330391.968398:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792472960 00000100:00100000:0.0:1788330391.968429:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792473216 00000100:00100000:0.0:1788330391.968442:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792473216 00000100:00100000:0.0:1788330391.968459:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788330391.968466:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eee7643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792472960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330391.968685:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eee7643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792472960:12345-0@lo:400:kworker.0 Request processed in 219us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330391.968694:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788330391.968713:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788330391.968719:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792473216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330391.968754:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792473216:12345-0@lo:400:kworker.0 Request processed in 36us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330391.968760:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788330391.968791:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792473216:0@lo:400:kworker.0 00000100:00100000:0.0:1788330391.968818:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792472960:0@lo:400:kworker.0 00000100:00100000:3.0:1788330391.968973:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788330391.968986:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792473856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330391.969045:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875199792473856:12345-0@lo:400:kworker.0 Request processed in 64us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330391.969051:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788330391.969085:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792473344 00000100:00100000:3.0:1788330391.969089:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792473344 00000100:00100000:3.0:1788330391.969171:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788330391.969180:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffcf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792473344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330391.969214:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792473344:12345-0@lo:400:kworker.0 Request processed in 36us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330391.969220:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788330391.969734:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330391.969744:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788330391.969747:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330391.969980:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792473344:0@lo:400:kworker.0 00000100:00100000:0.0:1788330391.969994:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875199792473856:0@lo:400:kworker.0 00000100:00100000:2.0:1788330391.970224:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffcfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875199792473728:12345-0@lo:400:kworker.0 Request processed in 1967us (2266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330391.970233:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1788330391.970602:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99edc8453100 x1875199792473728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330391.970617:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875199792473728:0@lo:400:kworker.0 00010000:00010000:0.0:1788330392.155338:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330392.476541:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792474112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788330392.476634:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330392.476944:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792474112 00000100:00100000:1.0:1788330392.476956:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792474112 00000100:00100000:1.0:1788330392.477059:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788330392.477072:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792474112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788330392.477102:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788330392.477251:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875199792474112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 181us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330392.477259:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788330392.477357:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875199792474112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788330392.802787:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330392.802883:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766164864 00000100:00100000:1.0:1788330392.802898:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766164864 00000100:00100000:1.0:1788330392.802973:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 150 00000100:00100000:1.0:1788330392.802988:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+11:14921:x1875199766164864:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330392.803012:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330392.803041:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eefe7ee600/0x8475908e9fd254f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61062be expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330392.803087:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eefe7ee600/0x8475908e9fd254f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062be expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330392.803098:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eefe7ee600/0x8475908e9fd254f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062be expref: 12 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330392.803109:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eefe7ee600, rc 0) 00000100:00100000:1.0:1788330392.803319:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+12:14921:x1875199766164864:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 Request processed in 332us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330392.803327:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 150 00000100:00100000:3.0:1788330392.808283:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330392.808419:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766164992 00000100:00100000:1.0:1788330392.808432:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766164992 00000100:00100000:1.0:1788330392.808504:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 151 00000100:00100000:1.0:1788330392.808517:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+12:14921:x1875199766164992:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330392.808843:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+12:14921:x1875199766164992:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 Request processed in 327us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330392.808853:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 151 00000100:00100000:2.0:1788330392.817845:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330392.818777:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766165120 00000100:00100000:2.0:1788330392.818794:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766165120 00000100:00100000:2.0:1788330392.818860:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 152 00000100:00100000:2.0:1788330392.818872:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+12:14921:x1875199766165120:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330392.820338:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+12:14921:x1875199766165120:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 Request processed in 1455us (2496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330392.820353:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 152 00000100:00100000:2.0:1788330392.836698:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330392.836759:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766165248 00000100:00100000:2.0:1788330392.836775:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766165248 00000100:00100000:2.0:1788330392.836847:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 153 00000100:00100000:2.0:1788330392.836861:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+12:14921:x1875199766165248:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330392.836884:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330392.836911:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eec9038200/0x8475908e9fd2556 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61062c5 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330392.836956:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eec9038200/0x8475908e9fd2556 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062c5 expref: 13 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330392.836971:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eec9038200/0x8475908e9fd2556 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062c5 expref: 13 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330392.836985:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038200, rc 0) 00000100:00100000:2.0:1788330392.837084:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:14921:x1875199766165248:12345-192.168.202.50@tcp:101:ll_cfg_requeue.0 Request processed in 225us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330392.837093:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 153 00000100:00100000:0.0:1788330392.847021:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330392.847086:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766165376 00000100:00100000:2.0:1788330392.847101:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766165376 00000100:00100000:2.0:1788330392.847185:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 154 00000100:00100000:2.0:1788330392.847198:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:14921:x1875199766165376:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330392.847543:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:14921:x1875199766165376:12345-192.168.202.50@tcp:501:ll_cfg_requeue.0 Request processed in 345us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330392.847553:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 154 00000100:00100000:3.0:1788330392.853925:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330392.854337:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766165504 00000100:00100000:1.0:1788330392.854352:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766165504 00000100:00100000:1.0:1788330392.854420:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 155 00000100:00100000:1.0:1788330392.854433:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:14921:x1875199766165504:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330392.855894:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:14921:x1875199766165504:12345-192.168.202.50@tcp:503:ll_cfg_requeue.0 Request processed in 1447us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330392.855911:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 155 00010000:00010000:0.0:1788330393.180449:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788330393.376424:0:17101:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788330393.376436:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99edc7f1d000 from 13 10000000:01000000:0.0:1788330393.376445:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788330393.376531:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd255d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330393.376547:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd255d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330393.376562:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd255d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330393.376595:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792474240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788330393.376872:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330393.376940:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeded4b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788330393.377095:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792474240 00000100:00100000:1.0:1788330393.377128:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792474240 00000100:00100000:1.0:1788330393.377225:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788330393.377239:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec909c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+20:17101:x1875199792474240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330393.377256:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330393.377275:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eefe7ef400/0x8475908e9fd2564 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd255d expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330393.377308:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eefe7ef400/0x8475908e9fd2564 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd255d expref: 21 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330393.377322:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eefe7ef400/0x8475908e9fd2564 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd255d expref: 21 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330393.377333:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eefe7ef400, rc 0) 00000100:00100000:1.0:1788330393.377410:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec909c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:17101:x1875199792474240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330393.377419:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788330393.378682:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792474240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330393.378717:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd255d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2564 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330393.378732:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd255d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2564 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330393.378843:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792474368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330393.378941:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330393.379010:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeded4b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788330393.379282:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792474368 00000100:00100000:1.0:1788330393.379292:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792474368 00000100:00100000:1.0:1788330393.379342:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788330393.379352:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec909fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:17101:x1875199792474368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330393.379532:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec909fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:17101:x1875199792474368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330393.379543:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000040:00080000:3.0:1788330393.379711:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788330393.380332:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792474368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330393.380385:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792474496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330393.380446:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330393.380489:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeded4b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788330393.380570:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792474496 00000100:00100000:3.0:1788330393.380578:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792474496 00000100:00100000:3.0:1788330393.381005:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788330393.381018:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec909c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:17101:x1875199792474496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330393.381183:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec909c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:17101:x1875199792474496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330393.381193:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788330393.381302:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792474496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788330393.382016:0:20218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788330393.382085:0:17101:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788330393.382105:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788330393.382119:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd255d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2564 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330393.382131:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef6e78c00/0x8475908e9fd255d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2564 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330393.382142:0:17101:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788330393.382145:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eec91d5800 from 13 10000000:01000000:0.0:1788330393.382175:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788330393.382212:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd256b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330393.382220:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd256b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330393.382229:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd256b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330393.382253:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffd69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792474624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788330393.382312:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330393.382664:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeded4b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788330393.382744:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792474624 00000100:00100000:1.0:1788330393.382754:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792474624 00000100:00100000:1.0:1788330393.382797:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788330393.382806:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+21:17101:x1875199792474624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330393.382832:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330393.382846:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eefe7eec00/0x8475908e9fd2572 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd256b expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330393.382877:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eefe7eec00/0x8475908e9fd2572 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd256b expref: 22 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330393.382888:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eefe7eec00/0x8475908e9fd2572 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd256b expref: 22 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330393.382899:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eefe7eec00, rc 0) 00000100:00100000:1.0:1788330393.382962:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec909cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:17101:x1875199792474624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330393.382970:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788330393.383016:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffd69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792474624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330393.383033:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd256b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2572 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330393.383044:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd256b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2572 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330393.383110:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6607480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792474752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330393.383136:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330393.383182:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee73336c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330393.383192:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792474752 00000100:00100000:1.0:1788330393.383194:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792474752 00000100:00100000:1.0:1788330393.383210:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788330393.383215:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec909ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:17101:x1875199792474752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330393.383343:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec909ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:17101:x1875199792474752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330393.383349:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788330393.383374:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6607480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792474752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330393.383401:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6607480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792474880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330393.383436:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330393.383450:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee73336c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330393.383503:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792474880 00000100:00100000:1.0:1788330393.383507:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792474880 00000100:00100000:1.0:1788330393.383523:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788330393.383528:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:17101:x1875199792474880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330393.383612:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:17101:x1875199792474880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330393.383619:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788330393.383773:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6607480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792474880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788330393.384557:0:20219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788330393.384695:0:17101:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788330393.384717:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788330393.384728:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd256b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2572 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330393.384739:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eef6e79200/0x8475908e9fd256b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2572 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330393.384752:0:17101:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788330393.384755:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99eee721d800 from 13 10000000:01000000:1.0:1788330393.384766:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788330393.384799:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7ef200/0x8475908e9fd2579 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330393.384808:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eefe7ef200/0x8475908e9fd2579 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330393.384818:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eefe7ef200/0x8475908e9fd2579 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330393.384840:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6607480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792475008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788330393.384893:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330393.384931:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee73330c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330393.384947:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792475008 00000100:00100000:1.0:1788330393.384952:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792475008 00000100:00100000:1.0:1788330393.384981:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788330393.384990:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+22:17101:x1875199792475008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330393.385000:0:17097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330393.385014:0:17097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eefe7ef000/0x8475908e9fd2580 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2579 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330393.385035:0:17097:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eefe7ef000/0x8475908e9fd2580 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2579 expref: 23 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330393.385044:0:17097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eefe7ef000/0x8475908e9fd2580 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2579 expref: 23 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330393.385053:0:17097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eefe7ef000, rc 0) 00000100:00100000:1.0:1788330393.385089:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:17101:x1875199792475008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330393.385106:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788330393.385147:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6607480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792475008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330393.385187:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eefe7ef200/0x8475908e9fd2579 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2580 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330393.385197:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eefe7ef200/0x8475908e9fd2579 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd2580 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330393.385250:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6607480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792475136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330393.385275:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330393.385297:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeca40bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788330393.385308:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792475136 00000100:00100000:1.0:1788330393.385312:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792475136 00000100:00100000:1.0:1788330393.385332:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788330393.385338:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:17101:x1875199792475136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330393.385442:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:17101:x1875199792475136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330393.385449:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788330393.385491:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6607480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792475136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330393.386958:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6607480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792475264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330393.387043:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330393.387093:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeca40bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788330393.387113:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792475264 00000100:00100000:1.0:1788330393.387120:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792475264 00000100:00100000:1.0:1788330393.387182:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788330393.387201:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:17101:x1875199792475264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330393.387336:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:17101:x1875199792475264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330393.387344:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788330393.387404:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6607480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792475264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788330393.388908:0:20221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788330393.389080:0:17101:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788330393.389110:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788330393.389122:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7ef200/0x8475908e9fd2579 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2580 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330393.389136:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eefe7ef200/0x8475908e9fd2579 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd2580 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330393.389255:0:17101:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788330393.389260:0:17101:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99edc7d05800 from 13 10000000:01000000:1.0:1788330393.389265:0:17101:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788330393.389318:0:17101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7ee800/0x8475908e9fd2587 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330393.389327:0:17101:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.150@tcp lock: ffff99eefe7ee800/0x8475908e9fd2587 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330393.389341:0:17101:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.150@tcp lock: ffff99eefe7ee800/0x8475908e9fd2587 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330393.389371:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc6607480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792475392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788330393.389454:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330393.389638:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeca40bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788330393.389746:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792475392 00000100:00100000:0.0:1788330393.389755:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792475392 00000100:00100000:0.0:1788330393.389843:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788330393.389856:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+23:17101:x1875199792475392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330393.389871:0:17098:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330393.389886:0:17098:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99eef6e79a00/0x8475908e9fd258e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8475908e9fd2587 expref: -99 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330393.389912:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99eef6e79a00/0x8475908e9fd258e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8475908e9fd2587 expref: 24 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330393.389923:0:17098:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99eef6e79a00/0x8475908e9fd258e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8475908e9fd2587 expref: 24 pid: 17098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330393.389932:0:17098:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79a00, rc 0) 00000100:00100000:0.0:1788330393.389991:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:17101:x1875199792475392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330393.389998:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788330393.390079:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc6607480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792475392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330393.390095:0:17101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.150@tcp lock: ffff99eefe7ee800/0x8475908e9fd2587 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd258e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330393.390105:0:17101:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.150@tcp lock: ffff99eefe7ee800/0x8475908e9fd2587 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8475908e9fd258e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330393.390189:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792475520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330393.390220:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330393.390318:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788330393.390345:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792475520 00000100:00100000:1.0:1788330393.390349:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792475520 00000100:00100000:1.0:1788330393.390370:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788330393.390376:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:17101:x1875199792475520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330393.390591:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:17101:x1875199792475520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 213us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330393.390599:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788330393.390760:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792475520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330393.390792:0:17101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792475648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330393.390842:0:17101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330393.390895:0:17101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788330393.390926:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792475648 00000100:00100000:1.0:1788330393.390931:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792475648 00000100:00100000:1.0:1788330393.390986:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788330393.390994:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:17101:x1875199792475648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330393.391095:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:17101:x1875199792475648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330393.391102:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788330393.391181:0:17101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:17101:1875199792475648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788330393.391889:0:20222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788330393.391953:0:17101:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788330393.391973:0:17101:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788330393.391984:0:17101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.150@tcp lock: ffff99eefe7ee800/0x8475908e9fd2587 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd258e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330393.391995:0:17101:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.150@tcp lock: ffff99eefe7ee800/0x8475908e9fd2587 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8475908e9fd258e expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330393.503406:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792475776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330393.503532:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330393.503614:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792475776 00000100:00100000:2.0:1788330393.503625:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792475776 00000100:00100000:2.0:1788330393.503689:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788330393.503700:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792475776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788330393.503751:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788330393.503806:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875199792475776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330393.503814:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788330393.503871:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792475776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330393.504434:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788330393.504867:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eef6ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792475904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330393.504925:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330393.505024:0:19787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792475904 00000100:00100000:3.0:1788330393.505034:0:19787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792475904 00000100:00100000:3.0:1788330393.505091:0:19787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788330393.505100:0:19787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792475904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788330393.505137:0:19787:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788330393.505220:0:19787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875199792475904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330393.505228:0:19787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788330393.505476:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eef6ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875199792475904:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788330394.203413:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330394.339819:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330394.339880:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330394.339920:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330394.339955:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330394.339980:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330394.340014:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330394.340055:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330394.340074:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330394.340095:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330394.340112:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766166144 00000100:00100000:3.0:1788330394.340118:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766165888 00000100:00100000:3.0:1788330394.340125:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766165888 00000100:00100000:2.0:1788330394.340125:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766166144 00000100:00100000:0.0:1788330394.340204:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766165632 00000100:00100000:0.0:1788330394.340209:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766165632 00000100:00100000:0.0:1788330394.340273:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 168 00000100:00100000:0.0:1788330394.340285:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:2411:x1875199766165632:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330394.340378:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:2411:x1875199766165632:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 95us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330394.340386:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 168 00000100:00100000:0.0:1788330394.340544:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766166656 00000100:00100000:0.0:1788330394.340554:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766166656 00000100:00100000:3.0:1788330394.340645:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766166400 00000100:00100000:3.0:1788330394.340649:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766166400 00000100:00100000:1.0:1788330394.340707:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766165760 00000100:00100000:1.0:1788330394.340711:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766165760 00000100:00100000:2.0:1788330394.346197:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766166016 00000100:00100000:2.0:1788330394.346217:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766166016 00000100:00100000:2.0:1788330394.346243:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766166528 00000100:00100000:2.0:1788330394.346246:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766166528 00000100:00100000:2.0:1788330394.346274:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:2.0:1788330394.346288:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2411:x1875199766166144:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330394.346422:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2411:x1875199766166144:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 137us (6500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330394.346431:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:2.0:1788330394.346464:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:2.0:1788330394.346488:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2411:x1875199766166016:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330394.346519:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2411:x1875199766166016:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 33us (6464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330394.346525:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:2.0:1788330394.346538:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:2.0:1788330394.346544:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2411:x1875199766166528:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330394.346567:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2411:x1875199766166528:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 23us (6471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330394.346573:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:2.0:1788330394.346613:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766166272 00000100:00100000:2.0:1788330394.346617:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766166272 00000100:00100000:2.0:1788330394.346641:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 62 00000100:00100000:2.0:1788330394.346649:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eef6ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2411:x1875199766165888:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330394.346676:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eef6ea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2411:x1875199766165888:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 28us (6797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330394.346682:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 62 00000100:00100000:2.0:1788330394.346696:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:2.0:1788330394.346702:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:2411:x1875199766166272:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330394.346723:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:2411:x1875199766166272:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 22us (6649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330394.346729:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00080000:2.0:1788330394.347033:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788330394.347040:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788330394.347043:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330394.347053:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788330394.350863:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:0.0:1788330394.350884:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2411:x1875199766166656:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330394.351018:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2411:x1875199766166656:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 140us (11035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330394.351028:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00080000:2.0:1788330394.356078:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330394.358256:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 64 00000100:00100000:3.0:1788330394.358281:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7e75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2411:x1875199766166400:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330394.358407:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7e75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2411:x1875199766166400:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 136us (18450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330394.358416:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 64 00000100:00080000:2.0:1788330394.359345:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788330394.365037:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 65 00000100:00100000:1.0:1788330394.365064:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:2411:x1875199766165760:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330394.365230:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:2411:x1875199766165760:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 176us (25214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330394.365238:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 65 00000100:00080000:2.0:1788330394.365940:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330394.785555:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330394.785682:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766166784 00000100:00100000:2.0:1788330394.785694:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766166784 00000100:00100000:2.0:1788330394.785836:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:2.0:1788330394.785851:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:15588:x1875199766166784:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330394.785885:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330394.785912:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd2595 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61062cc expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.786349:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd259c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.786367:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd259c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.786381:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd259c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.786398:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd25a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.786405:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd25a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.786411:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd25a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.786524:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd25aa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.786550:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd25aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.786557:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd25aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330394.786597:0:17105:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788330394.786602:0:17105:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330394.786649:0:17105:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd25aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.786662:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd259c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.786668:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd259c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.786675:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd259c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.786681:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330394.786686:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd259c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.786693:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd259c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.786706:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99edc10b5000) 00010000:00010000:2.0:1788330394.786709:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330394.786713:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd259c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.790353:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd259c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.790453:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd25a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.790461:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd25a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.790468:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd25a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.790473:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330394.790479:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd25a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.790488:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd25a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.790509:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99edc10b5100) 00010000:00010000:2.0:1788330394.790512:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330394.790517:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd25a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.790524:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd25a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.790603:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd2595 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062cc expref: 8 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.790621:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038000/0x8475908e9fd25aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062cc expref: 7 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.790647:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99edc10b5b00) 00010000:00010000:2.0:1788330394.790650:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330394.790653:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038000, rc 0) 00000100:00100000:2.0:1788330394.790764:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+7:15588:x1875199766166784:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 4914us (5225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330394.790776:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 23 00000100:00100000:0.0:1788330394.800668:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330394.800861:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766166912 00000100:00100000:3.0:1788330394.800876:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766166912 00000100:00100000:3.0:1788330394.800960:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:3.0:1788330394.800974:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+7:15588:x1875199766166912:12345-192.168.202.50@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788330394.801091:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+7:15588:x1875199766166912:12345-192.168.202.50@tcp:900:lhsmtool_posix.0 Request processed in 120us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330394.801100:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:3.0:1788330394.808292:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330394.808386:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330394.808595:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766167168 00000100:00100000:2.0:1788330394.808611:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766167168 00000100:00100000:2.0:1788330394.808676:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766167296 00000100:00100000:2.0:1788330394.808679:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766167296 00000100:00100000:2.0:1788330394.808715:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:2.0:1788330394.808728:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+8:15588:x1875199766167168:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330394.808758:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330394.808786:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd25b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61062d3 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.808886:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd25b8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.808900:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd25b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.808910:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd25b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.808921:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd25bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.808941:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd25bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.808945:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd25bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.809105:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd25c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.809113:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd25c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.809128:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd25c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330394.809140:0:17103:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788330394.809347:0:17103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd25b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.809354:0:17103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd25b8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.809358:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd25b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.809362:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330394.809366:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd25b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.809371:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd25b8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.809390:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99edc10b5b00) 00010000:00010000:2.0:1788330394.809392:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330394.809396:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd25b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.809400:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd25b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.809412:0:17103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd25bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.809416:0:17103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd25bf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.809419:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd25bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.809422:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330394.809424:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd25bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.809427:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd25bf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.809430:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99edc10b5100) 00010000:00010000:2.0:1788330394.809431:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330394.809433:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd25bf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.809436:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd25bf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330394.809579:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:1.0:1788330394.809608:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+10:15594:x1875199766167296:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:1.0:1788330394.809623:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330394.809642:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7eea00/0x8475908e9fd25d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61062da expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809699:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd25db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809712:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd25db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809742:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd25db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809759:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd25e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809765:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd25e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809772:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd25e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809798:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd25db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809804:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd25db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809810:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd25db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809823:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330394.809826:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd25db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809832:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd25db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809841:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99edc10b5000) 00010000:00010000:1.0:1788330394.809843:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330394.809847:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd25db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809852:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd25db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809862:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd25e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809868:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd25e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809873:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd25e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809878:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ef800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330394.809880:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd25e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809885:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd25e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809900:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99eec9216100) 00010000:00010000:1.0:1788330394.809903:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330394.809906:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd25e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809911:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd25e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809940:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7eea00/0x8475908e9fd25d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062da expref: 11 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809952:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99edc10b5000) 00010000:00010000:1.0:1788330394.809955:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330394.809958:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7eea00/0x8475908e9fd25d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062da expref: 11 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.809987:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eefe7eea00, rc 0) 00000100:00100000:1.0:1788330394.810086:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+10:15594:x1875199766167296:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 485us (1697us total) trans 0 rc 301/301 00000100:00100000:1.0:1788330394.810094:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 25 00010000:00010000:2.0:1788330394.810263:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd25b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062d3 expref: 10 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.810280:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039800/0x8475908e9fd25c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062d3 expref: 9 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.810288:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99edc10b5400) 00010000:00010000:2.0:1788330394.810291:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330394.810294:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039800, rc 0) 00000100:00100000:2.0:1788330394.810326:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+9:15588:x1875199766167168:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 1601us (2050us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788330394.810335:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:3.0:1788330394.817300:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330394.817350:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330394.817378:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766167424 00000100:00100000:0.0:1788330394.817392:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766167424 00000100:00100000:0.0:1788330394.817483:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00100000:0.0:1788330394.817508:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+9:15588:x1875199766167424:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788330394.817673:0:17112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766167552 00000100:00100000:0.0:1788330394.817674:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+9:15588:x1875199766167424:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 Request processed in 169us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330394.817680:0:17112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766167552 00000100:00100000:0.0:1788330394.817688:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00100000:2.0:1788330394.817760:0:17112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:2.0:1788330394.817769:0:17112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+9:15594:x1875199766167552:12345-192.168.202.50@tcp:700:lfs.0 00000100:00100000:2.0:1788330394.817814:0:17112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+9:15594:x1875199766167552:12345-192.168.202.50@tcp:700:lfs.0 Request processed in 46us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330394.817821:0:17112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:0.0:1788330394.821637:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330394.821730:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330394.821816:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766167808 00000100:00100000:3.0:1788330394.821830:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766167808 00000100:00100000:3.0:1788330394.821912:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766167936 00000100:00100000:3.0:1788330394.821916:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766167936 00000100:00100000:3.0:1788330394.821964:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:3.0:1788330394.821976:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+9:15594:x1875199766167808:12345-192.168.202.50@tcp:36:lfs.0 00010000:00010000:3.0:1788330394.822057:0:18635:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330394.822093:0:18635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2502 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106247 expref: 9 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.822117:0:18635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99edc10b5000) 00010000:00010000:3.0:1788330394.822123:0:18635:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330394.822305:0:18635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd25e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.822323:0:18635:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b000/0x8475908e9fd2541 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062b7 expref: 5 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.822332:0:18635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd25e9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.822374:0:18635:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b000/0x8475908e9fd2541 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062b7 expref: 5 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.822390:0:18635:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b000/0x8475908e9fd2541 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062b7 expref: 5 pid: 17103 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330394.822406:0:18635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eec9778700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18635:1875199792476032:192.168.202.50@tcp:104: 00000100:00100000:3.0:1788330394.822602:0:18635:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec638e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788330394.823056:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:0.0:1788330394.823067:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:15588:x1875199766167936:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788330394.829333:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000004:00080000:2.0:1788330394.829365:0:17105:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6264us 00000100:00100000:0.0:1788330394.829378:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766168064 00000100:00100000:0.0:1788330394.829388:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766168064 00010000:00010000:0.0:1788330394.830183:0:17088:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b000/0x8475908e9fd2541 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062b7 expref: 6 pid: 17103 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330394.830250:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 15 00000100:00100000:0.0:1788330394.830272:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:2413:x1875199766168064:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330394.830294:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330394.830304:0:17088:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b000/0x8475908e9fd2541 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062b7 expref: 6 pid: 17103 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.830322:0:17088:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b000/0x8475908e9fd2541 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062b7 expref: 6 pid: 17103 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.830396:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99edc10b5000) 00010000:00010000:0.0:1788330394.830402:0:17088:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd25e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.830412:0:17088:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd25e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.830421:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd25e9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.830462:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330394.830744:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:2413:x1875199766168064:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 474us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330394.830753:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 15 00010000:00010000:3.0:1788330394.832970:0:18635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b000/0x8475908e9fd2541 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062b7 expref: 5 pid: 17103 timeout: 698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330394.833015:0:18635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eec9778700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18635:1875199792476032:192.168.202.50@tcp:104: 00010000:00010000:3.0:1788330394.833049:0:18635:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd25e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.833061:0:18635:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd25e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.833067:0:18635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd25e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.833242:0:18635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b800/0x8475908e9fd25f0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.833259:0:18635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b800/0x8475908e9fd25f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.833273:0:18635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b800/0x8475908e9fd25f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.836028:0:18635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b600/0x8475908e9fd25f7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.836051:0:18635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b600/0x8475908e9fd25f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.836061:0:18635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b600/0x8475908e9fd25f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330394.837326:0:18635:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004abd9495 reply state 0000000035377415 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b600/0x8475908e9fd25f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.837367:0:18635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b600/0x8475908e9fd25f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.837376:0:18635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99eecd8cb800) 00010000:00010000:3.0:1788330394.837379:0:18635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788330394.837384:0:18635:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788330394.837392:0:18635:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788330394.837416:0:18635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd25e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.837424:0:18635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd25e9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.837431:0:18635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd25e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.837436:0:18635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91bc00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330394.837441:0:18635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd25e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.837459:0:18635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd25e9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.837471:0:18635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99edc10b5000) 00010000:00010000:3.0:1788330394.837474:0:18635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330394.837478:0:18635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd25e9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.837484:0:18635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd25e9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330394.837520:0:18635:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004abd9495 reply state 0000000035377415 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b800/0x8475908e9fd25f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.837527:0:18635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b800/0x8475908e9fd25f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.837531:0:18635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99eecd8cbb00) 00010000:00010000:3.0:1788330394.837533:0:18635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788330394.837534:0:18635:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788330394.837669:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+10:15594:x1875199766167808:12345-192.168.202.50@tcp:36:lfs.0 Request processed in 15690us (16040us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788330394.837678:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:2.0:1788330394.855989:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:15588:x1875199766167936:12345-192.168.202.50@tcp:59:lhsmtool_posix.0 Request processed in 32906us (34240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330394.856008:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:2.0:1788330394.920955:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330394.921215:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766168192 00000100:00100000:1.0:1788330394.921230:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766168192 00000100:00100000:1.0:1788330394.921340:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 29 00000100:00100000:1.0:1788330394.921355:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+10:15602:x1875199766168192:12345-192.168.202.50@tcp:101:lctl.0 00010000:00010000:1.0:1788330394.921389:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330394.921418:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd25fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61062e1 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.921701:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd2605 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.921716:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd2605 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.921819:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd2605 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330394.921966:0:17104:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788330394.921970:0:17104:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788330394.922011:0:17104:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd2605 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.922036:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd25fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062e1 expref: 12 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.922052:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ef800/0x8475908e9fd2605 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062e1 expref: 11 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330394.922059:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eec9216100) 00010000:00010000:1.0:1788330394.922061:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788330394.922065:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eefe7ef800, rc 0) 00000100:00100000:0.0:1788330394.922467:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+11:15602:x1875199766168192:12345-192.168.202.50@tcp:101:lctl.0 Request processed in 1112us (1628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330394.922483:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 29 00000100:00100000:1.0:1788330394.941458:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330394.941730:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766168320 00000100:00100000:3.0:1788330394.941744:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766168320 00000100:00100000:3.0:1788330394.941863:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:3.0:1788330394.941876:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:15603:x1875199766168320:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:3.0:1788330394.941906:0:18635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330394.941935:0:18635:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd260c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61062e8 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.942034:0:18635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b000/0x8475908e9fd2613 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.942051:0:18635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b000/0x8475908e9fd2613 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.942065:0:18635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b000/0x8475908e9fd2613 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330394.942391:0:18635:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788330394.942396:0:18635:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788330394.942425:0:18635:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b000/0x8475908e9fd2613 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.942470:0:18635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd260c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062e8 expref: 7 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.942583:0:18635:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b000/0x8475908e9fd2613 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062e8 expref: 6 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330394.942594:0:18635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eec9216100) 00010000:00010000:3.0:1788330394.942597:0:18635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330394.942603:0:18635:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eeef91b000, rc 0) 00000100:00100000:3.0:1788330394.942709:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:15603:x1875199766168320:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 835us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330394.942718:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:1.0:1788330394.950258:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330394.950363:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766168448 00000100:00100000:2.0:1788330394.950388:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766168448 00000100:00100000:2.0:1788330394.950465:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:2.0:1788330394.950478:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:15603:x1875199766168448:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:2.0:1788330394.950507:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330394.950535:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd261a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61062ef expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.950615:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd2621 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.950631:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd2621 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.950645:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd2621 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.950659:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd2628 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.950667:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd2628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.950674:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd2628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.950762:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd262f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.950767:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd262f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.950772:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd262f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330394.950816:0:17103:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788330394.950820:0:17103:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330394.950843:0:17103:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd262f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.950949:0:17103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd2621 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.950955:0:17103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd2621 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.950960:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd2621 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.950964:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330394.950967:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd2621 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.950972:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd2621 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.950983:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eec9216100) 00010000:00010000:2.0:1788330394.950985:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330394.950988:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd2621 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.950992:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd2621 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.951004:0:17103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd2628 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.951015:0:17103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd2628 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.951019:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd2628 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.951022:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330394.951023:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd2628 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.951026:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd2628 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.951030:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99eecd8cbb00) 00010000:00010000:2.0:1788330394.951032:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330394.951033:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd2628 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.951036:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd2628 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.951061:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd261a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062ef expref: 8 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.951071:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd262f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062ef expref: 7 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330394.951077:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99eecd8cb800) 00010000:00010000:2.0:1788330394.951078:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330394.951084:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039200, rc 0) 00000100:00100000:2.0:1788330394.951295:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+7:15603:x1875199766168448:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 820us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330394.951302:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:0.0:1788330394.955525:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330394.955598:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766168576 00000100:00100000:3.0:1788330394.955610:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766168576 00000100:00100000:3.0:1788330394.955682:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:3.0:1788330394.955693:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:15603:x1875199766168576:12345-192.168.202.50@tcp:900:lfs.0 00000100:00100000:3.0:1788330394.955790:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:15603:x1875199766168576:12345-192.168.202.50@tcp:900:lfs.0 Request processed in 99us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330394.955795:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:2.0:1788330394.958390:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330394.958566:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766168832 00000100:00100000:0.0:1788330394.958578:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766168832 00000100:00100000:0.0:1788330394.958650:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:0.0:1788330394.958679:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14374cd5-fe9e-406e-8acf-b98a60f93e29+7:15603:x1875199766168832:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330394.958705:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330394.958736:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd2636 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61062f6 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330394.958951:0:17105:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788330394.959093:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd2636 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062f6 expref: 9 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.959111:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eec9216100) 00010000:00010000:0.0:1788330394.959115:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330394.959122:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd2636 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062f6 expref: 9 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.959140:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78a00, rc 0) 00000100:00100000:0.0:1788330394.959516:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:14374cd5-fe9e-406e-8acf-b98a60f93e29+8:15603:x1875199766168832:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 838us (1136us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788330394.959525:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:1.0:1788330394.963725:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330394.963832:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766169088 00000100:00100000:0.0:1788330394.963846:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766169088 00000100:00100000:0.0:1788330394.963929:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:0.0:1788330394.963941:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+8:15603:x1875199766169088:12345-192.168.202.50@tcp:36:lfs.0 00010000:00010000:0.0:1788330394.964021:0:17104:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330394.964060:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd262f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062ef expref: 8 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.964087:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99eecd8cb800) 00010000:00010000:0.0:1788330394.964115:0:17104:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330394.964146:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2644 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.964209:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2644 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.964220:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2644 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788330394.964587:0:17104:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000045598ce4 reply state 0000000049889906 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2644 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.964604:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2644 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.964611:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99eecd8cb800) 00010000:00010000:0.0:1788330394.964614:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788330394.964617:0:17104:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788330394.964626:0:17104:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788330394.964741:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+9:15603:x1875199766169088:12345-192.168.202.50@tcp:36:lfs.0 Request processed in 800us (1032us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788330394.964750:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 33 00000100:00100000:2.0:1788330394.969722:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330394.969806:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766169344 00000100:00100000:0.0:1788330394.969821:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766169344 00000100:00100000:0.0:1788330394.969901:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:0.0:1788330394.969913:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+9:15603:x1875199766169344:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:0.0:1788330394.970246:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+10:15603:x1875199766169344:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 333us (539us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788330394.970256:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:3.0:1788330394.976581:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330394.976763:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766169600 00000100:00100000:0.0:1788330394.976778:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766169600 00000100:00100000:0.0:1788330394.976921:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:0.0:1788330394.976934:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14374cd5-fe9e-406e-8acf-b98a60f93e29+10:15603:x1875199766169600:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330394.976969:0:18635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330394.976999:0:18635:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd264b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c61062fd expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977102:0:18635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd2652 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977120:0:18635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd2652 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977143:0:18635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd2652 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977200:0:18635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2659 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977208:0:18635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2659 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977215:0:18635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2659 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330394.977365:0:18635:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788330394.977502:0:18635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd2652 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977512:0:18635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd2652 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977538:0:18635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd2652 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977544:0:18635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330394.977550:0:18635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd2652 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977559:0:18635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd2652 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977574:0:18635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eec9216100) 00010000:00010000:0.0:1788330394.977578:0:18635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330394.977584:0:18635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd2652 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977592:0:18635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd2652 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977606:0:18635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2659 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977613:0:18635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2659 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977619:0:18635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2659 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977624:0:18635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330394.977627:0:18635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2659 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977648:0:18635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2659 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977656:0:18635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99eecd8cbb00) 00010000:00010000:0.0:1788330394.977659:0:18635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330394.977662:0:18635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2659 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977668:0:18635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2659 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977707:0:18635:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd264b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062fd expref: 12 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977732:0:18635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eec9216100) 00010000:00010000:0.0:1788330394.977734:0:18635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330394.977739:0:18635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78a00/0x8475908e9fd264b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c61062fd expref: 12 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.977751:0:18635:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78a00, rc 0) 00000100:00100000:0.0:1788330394.977839:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:14374cd5-fe9e-406e-8acf-b98a60f93e29+11:15603:x1875199766169600:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 907us (1275us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788330394.977849:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 34 00000100:00100000:1.0:1788330394.983819:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330394.984760:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766169728 00000100:00100000:0.0:1788330394.984778:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766169728 00000100:00100000:0.0:1788330394.984886:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 35 00000100:00100000:0.0:1788330394.984898:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+11:15603:x1875199766169728:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330394.984948:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330394.984982:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd2667 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106304 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.985112:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd266e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.985130:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd266e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.985144:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd266e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330394.985198:0:17104:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788330394.985203:0:17104:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788330394.985227:0:17104:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd266e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.985260:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd2667 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106304 expref: 13 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.985281:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd266e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106304 expref: 12 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330394.985291:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99eecd8cb800) 00010000:00010000:0.0:1788330394.985293:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788330394.985298:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78200, rc 0) 00000100:00100000:0.0:1788330394.986301:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+12:15603:x1875199766169728:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 1394us (2489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330394.986312:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 35 00000100:00100000:3.0:1788330394.991975:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330394.992098:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766169856 00000100:00100000:0.0:1788330394.992112:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766169856 00000100:00100000:0.0:1788330394.992249:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:0.0:1788330394.992259:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+12:15603:x1875199766169856:12345-192.168.202.50@tcp:37:lfs.0 00000100:00100000:0.0:1788330395.002314:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+12:15603:x1875199766169856:12345-192.168.202.50@tcp:37:lfs.0 Request processed in 10037us (10333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330395.002343:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 3 00000100:00100000:1.0:1788330395.010643:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330395.010828:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766170112 00000100:00100000:3.0:1788330395.010841:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766170112 00000100:00100000:3.0:1788330395.010932:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:3.0:1788330395.010946:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec53d2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+12:15603:x1875199766170112:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:3.0:1788330395.011301:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec53d2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:14374cd5-fe9e-406e-8acf-b98a60f93e29+13:15603:x1875199766170112:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 357us (677us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788330395.011309:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 4 00000100:00100000:3.0:1788330395.094855:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330395.094992:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766170240 00000100:00100000:2.0:1788330395.095006:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766170240 00000100:00100000:2.0:1788330395.095084:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00100000:2.0:1788330395.095097:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+11:15609:x1875199766170240:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1788330395.095126:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330395.095193:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd2675 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610630b expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095286:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd267c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095306:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd267c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095334:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd267c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095348:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd2683 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095356:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd2683 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095363:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd2683 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095516:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd268a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095525:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd268a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095531:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd268a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330395.095577:0:17105:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788330395.095582:0:17105:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330395.095632:0:17105:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd268a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095646:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd267c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095653:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd267c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095660:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd267c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095666:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9038800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330395.095672:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd267c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095680:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd267c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095694:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eec9216100) 00010000:00010000:2.0:1788330395.095703:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330395.095709:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd267c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095715:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd267c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095732:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd2683 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095738:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd2683 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095743:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd2683 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095748:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039200 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330395.095751:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd2683 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095757:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd2683 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095764:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99eecd8cbb00) 00010000:00010000:2.0:1788330395.095767:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330395.095770:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd2683 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095776:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd2683 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095808:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd2675 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610630b expref: 13 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095834:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038e00/0x8475908e9fd268a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610630b expref: 12 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.095841:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99eecd8cb800) 00010000:00010000:2.0:1788330395.095843:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788330395.095846:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9038e00, rc 0) 00000100:00100000:2.0:1788330395.095920:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+12:15609:x1875199766170240:12345-192.168.202.50@tcp:101:bash.0 Request processed in 825us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330395.095929:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 36 00000100:00100000:2.0:1788330395.099628:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330395.099700:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766170368 00000100:00100000:3.0:1788330395.099715:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766170368 00000100:00100000:3.0:1788330395.099793:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:3.0:1788330395.099807:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:15609:x1875199766170368:12345-192.168.202.50@tcp:900:bash.0 00000100:00100000:3.0:1788330395.100063:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:15609:x1875199766170368:12345-192.168.202.50@tcp:900:bash.0 Request processed in 258us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330395.100074:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:3.0:1788330395.102771:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330395.103634:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766170624 00000100:00100000:2.0:1788330395.103649:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766170624 00000100:00100000:2.0:1788330395.103715:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 37 00000100:00100000:2.0:1788330395.103725:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+12:15609:x1875199766170624:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1788330395.103752:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330395.103779:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd2691 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106312 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.103912:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2698 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.103930:0:17103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd266e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106304 expref: 12 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.103940:0:17103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2698 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.104003:0:17103:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd266e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106304 expref: 12 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.104019:0:17103:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd266e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106304 expref: 12 pid: 17104 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330395.104036:0:17103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17103:1875199792476160:192.168.202.50@tcp:104: 00000100:00100000:2.0:1788330395.104189:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eec920cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330395.109113:0:17103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc8451500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17103:1875199792476160:192.168.202.50@tcp:104: 00010000:00010000:2.0:1788330395.109190:0:17103:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2698 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330395.112855:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330395.113198:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766170752 00000100:00100000:2.0:1788330395.113212:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766170752 00010000:00010000:2.0:1788330395.113269:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd266e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106304 expref: 13 pid: 17104 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330395.113339:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 16 00000100:00100000:2.0:1788330395.113352:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+13:2413:x1875199766170752:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330395.113373:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330395.113382:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd266e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106304 expref: 13 pid: 17104 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.113398:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd266e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106304 expref: 13 pid: 17104 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.113458:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78200/0x8475908e9fd266e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106304 expref: 13 pid: 17104 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.113490:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99eecd8cb800) 00010000:00010000:2.0:1788330395.113497:0:17089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2698 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.113511:0:17089:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2698 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.113519:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2698 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.113554:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330395.113901:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+12:2413:x1875199766170752:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 550us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330395.113911:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 16 00010000:00010000:3.0:1788330395.114049:0:17103:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2698 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.114059:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2698 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.114088:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd269f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.114099:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd269f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.114121:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd269f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.114929:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd26a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.114946:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd26a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.114955:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd26a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330395.114966:0:17103:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788330395.114997:0:17103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2698 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.115005:0:17103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2698 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.115012:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2698 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.115018:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330395.115023:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2698 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.115032:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2698 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.115045:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99eecd8cb800) 00010000:00010000:3.0:1788330395.115048:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330395.115065:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2698 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.115072:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd2698 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330395.115089:0:17103:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e3f23066 reply state 000000002f802e24 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd269f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.115102:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd269f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.115108:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff99eecd8cbf00) 00010000:00010000:3.0:1788330395.115111:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788330395.115113:0:17103:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788330395.115450:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038400/0x8475908e9fd2691 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106312 expref: 15 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.115472:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd26a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106312 expref: 14 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.115533:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:3.0:1788330395.115535:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788330395.115538:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eeef91ac00, rc 0) 00000100:00100000:3.0:1788330395.115608:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+15:15609:x1875199766170624:12345-192.168.202.50@tcp:101:bash.0 Request processed in 11884us (12852us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788330395.115617:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 37 00000100:00100000:0.0:1788330395.149621:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330395.149744:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766170880 00000100:00100000:2.0:1788330395.149757:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766170880 00000100:00100000:2.0:1788330395.149837:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 38 00000100:00100000:2.0:1788330395.149849:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+15:15609:x1875199766170880:12345-192.168.202.50@tcp:101:bash.0 00010000:00010000:2.0:1788330395.149881:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330395.149909:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd26b4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106319 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.150007:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd26bb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.150046:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd26bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.150060:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd26bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330395.150133:0:17105:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788330395.150138:0:17105:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788330395.150204:0:17105:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd26bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.150217:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd26bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.150249:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd26b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106319 expref: 17 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.150270:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd26bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106319 expref: 16 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.150280:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:2.0:1788330395.150283:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330395.150286:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039200, rc 0) 00000100:00100000:2.0:1788330395.150365:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+16:15609:x1875199766170880:12345-192.168.202.50@tcp:101:bash.0 Request processed in 518us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330395.150373:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 38 00000100:00100000:0.0:1788330395.153449:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330395.153637:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766171136 00000100:00100000:3.0:1788330395.153654:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766171136 00000100:00100000:3.0:1788330395.153730:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 5 00000100:00100000:3.0:1788330395.153743:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffd6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+16:15609:x1875199766171136:12345-192.168.202.50@tcp:35:bash.0 00000100:00100000:3.0:1788330395.154194:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffd6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+17:15609:x1875199766171136:12345-192.168.202.50@tcp:35:bash.0 Request processed in 452us (767us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788330395.154205:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 5 00010000:00010000:0.0:1788330395.227583:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330395.238211:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330395.238346:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766171392 00000100:00100000:0.0:1788330395.238359:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766171392 00000100:00100000:0.0:1788330395.238453:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00100000:0.0:1788330395.238468:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+17:15619:x1875199766171392:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330395.238604:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330395.238631:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd26c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106320 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330395.238761:0:17104:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788330395.238908:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd26c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106320 expref: 19 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.238927:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99eec9216100) 00010000:00010000:0.0:1788330395.238930:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330395.238936:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd26c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106320 expref: 19 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.238954:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79600, rc 0) 00000100:00100000:0.0:1788330395.239105:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+18:15619:x1875199766171392:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 640us (955us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788330395.239115:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 39 00000100:00100000:1.0:1788330395.243836:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330395.243944:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766171648 00000100:00100000:3.0:1788330395.243957:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766171648 00000100:00100000:3.0:1788330395.244028:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:3.0:1788330395.244041:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+18:15619:x1875199766171648:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:3.0:1788330395.244372:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+19:15619:x1875199766171648:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 333us (553us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788330395.244381:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 6 00000100:00100000:2.0:1788330395.289665:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330395.289821:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766171904 00000100:00100000:0.0:1788330395.289834:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766171904 00000100:00100000:0.0:1788330395.289969:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 40 00000100:00100000:0.0:1788330395.289982:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+19:15622:x1875199766171904:12345-192.168.202.50@tcp:101:lfs.0 00010000:00010000:0.0:1788330395.290018:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330395.290049:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd26d0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106327 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.290234:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd26d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.290251:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd26d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.290265:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd26d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330395.290278:0:17105:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788330395.290450:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd26d0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106327 expref: 22 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.290471:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd26d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106327 expref: 21 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.290498:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:0.0:1788330395.290501:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330395.290520:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79e00, rc 0) 00000100:00100000:0.0:1788330395.290610:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+21:15622:x1875199766171904:12345-192.168.202.50@tcp:101:lfs.0 Request processed in 630us (1299us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788330395.290619:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 40 00000100:00100000:1.0:1788330395.296803:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330395.296920:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330395.297008:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766172160 00000100:00100000:2.0:1788330395.297022:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766172160 00000100:00100000:2.0:1788330395.297120:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:2.0:1788330395.297134:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6606d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+21:2413:x1875199766172160:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330395.297175:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330395.297208:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd26d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106327 expref: 21 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.297230:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:2.0:1788330395.297235:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330395.297310:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6606d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+20:2413:x1875199766172160:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 178us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330395.297326:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:3.0:1788330395.298791:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766172032 00000100:00100000:3.0:1788330395.298805:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766172032 00000100:00100000:3.0:1788330395.298904:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 41 00000100:00100000:3.0:1788330395.298915:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+20:15622:x1875199766172032:12345-192.168.202.50@tcp:54:lfs.0 00010000:00010000:3.0:1788330395.298999:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd26e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.299019:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd26e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.299033:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd26e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.299078:0:17103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd26e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.299085:0:17103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd26e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.299105:0:17103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd26e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.299112:0:17103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91aa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330395.299117:0:17103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd26e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.299126:0:17103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd26e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.299140:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:3.0:1788330395.299143:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788330395.299177:0:17103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd26e5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.299185:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd26e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330395.299330:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+20:15622:x1875199766172032:12345-192.168.202.50@tcp:54:lfs.0 Request processed in 407us (2532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330395.299338:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 41 00000100:00100000:1.0:1788330395.305962:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330395.306676:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766172416 00000100:00100000:0.0:1788330395.306691:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766172416 00000100:00100000:0.0:1788330395.306799:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 7 00000100:00100000:0.0:1788330395.306812:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+20:15622:x1875199766172416:12345-192.168.202.50@tcp:35:lfs.0 00000100:00100000:0.0:1788330395.307107:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+21:15622:x1875199766172416:12345-192.168.202.50@tcp:35:lfs.0 Request processed in 296us (1161us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788330395.307116:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 7 00000040:00080000:3.0:1788330395.420070:0:17856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788330395.607769:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330395.608019:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766172672 00000100:00100000:3.0:1788330395.608036:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766172672 00000100:00100000:3.0:1788330395.608131:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:3.0:1788330395.608144:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc6607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+21:15653:x1875199766172672:12345-192.168.202.50@tcp:101:cat.0 00010000:00010000:2.0:1788330395.608427:0:18635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330395.608501:0:18635:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd26ec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610632e expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.608670:0:18635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd26f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.608691:0:18635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd26f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.608706:0:18635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd26f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330395.608721:0:18635:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788330395.608877:0:18635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9038800/0x8475908e9fd26ec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610632e expref: 24 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.608902:0:18635:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd26f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610632e expref: 23 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.608929:0:18635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:2.0:1788330395.608932:0:18635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330395.608936:0:18635:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec9039400, rc 0) 00000100:00100000:2.0:1788330395.609032:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc6607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+23:15653:x1875199766172672:12345-192.168.202.50@tcp:101:cat.0 Request processed in 890us (1279us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788330395.609041:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 42 00000100:00100000:1.0:1788330395.612411:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330395.612501:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330395.612655:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766173056 00000100:00100000:0.0:1788330395.612669:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766173056 00000100:00100000:0.0:1788330395.612748:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:0.0:1788330395.612761:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+23:2412:x1875199766173056:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330395.612780:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330395.612813:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039400/0x8475908e9fd26f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610632e expref: 23 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.612838:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:0.0:1788330395.612845:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330395.612928:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+22:2412:x1875199766173056:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 169us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330395.612937:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:3.0:1788330395.614128:0:17106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766172928 00000100:00100000:3.0:1788330395.614145:0:17106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766172928 00000100:00100000:3.0:1788330395.614500:0:17106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:3.0:1788330395.614526:0:17106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+22:15653:x1875199766172928:12345-192.168.202.50@tcp:35:cat.0 00000100:00100000:3.0:1788330395.614929:0:17106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+23:15653:x1875199766172928:12345-192.168.202.50@tcp:35:cat.0 Request processed in 404us (2532us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788330395.614938:0:17106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 8 00000100:00100000:1.0:1788330395.669286:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330395.669464:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766173312 00000100:00100000:0.0:1788330395.669480:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766173312 00000100:00100000:0.0:1788330395.669581:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:0.0:1788330395.669613:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+23:15659:x1875199766173312:12345-192.168.202.50@tcp:101:dd.0 00010000:00010000:0.0:1788330395.669662:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330395.669700:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2701 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106335 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.669885:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79000/0x8475908e9fd2708 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.669907:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd26a6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106312 expref: 24 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.669916:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd26bb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106319 expref: 24 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.669924:0:17104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79000/0x8475908e9fd2708 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.669973:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd26bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106319 expref: 24 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.669989:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd26bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106319 expref: 24 pid: 17105 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330395.670007:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17104:1875199792476288:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330395.670133:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd26a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106312 expref: 24 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.670143:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd26a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106312 expref: 24 pid: 17103 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330395.670205:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17104:1875199792476416:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330395.670236:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeded4b780 going to sleep for 11 seconds 00000040:00080000:1.0:1788330395.677046:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788330395.679057:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330395.679630:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17104:1875199792476288:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330395.679649:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17104:1875199792476416:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330395.679688:0:17104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79000/0x8475908e9fd2708 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330395.681669:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330395.686740:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766173440 00000100:00100000:2.0:1788330395.686762:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766173440 00010000:00010000:2.0:1788330395.686829:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd26bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106319 expref: 25 pid: 17105 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330395.686880:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766173568 00000100:00100000:2.0:1788330395.686883:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766173568 00010000:00010000:2.0:1788330395.686901:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd26a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106312 expref: 26 pid: 17103 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330395.686935:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 17 00000100:00100000:2.0:1788330395.686947:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+26:2412:x1875199766173440:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330395.686966:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330395.686975:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd26bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106319 expref: 26 pid: 17105 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.686995:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd26bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106319 expref: 26 pid: 17105 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.687029:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039200/0x8475908e9fd26bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106319 expref: 26 pid: 17105 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.687069:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:2.0:1788330395.687074:0:17089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79000/0x8475908e9fd2708 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330395.687351:0:19442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 18 00000100:00100000:0.0:1788330395.687364:0:19442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed06a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+25:2412:x1875199766173568:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330395.687373:0:19442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330395.687387:0:19442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd26a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106312 expref: 25 pid: 17103 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.687812:0:17089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79000/0x8475908e9fd2708 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330395.687825:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330395.687923:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+25:2412:x1875199766173440:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 977us (8884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330395.687933:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 17 00010000:00010000:0.0:1788330395.689574:0:19442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd26a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106312 expref: 24 pid: 17103 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.689681:0:19442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd26a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106312 expref: 24 pid: 17103 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.689700:0:19442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:0.0:1788330395.689706:0:19442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79000/0x8475908e9fd2708 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.689716:0:19442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79000/0x8475908e9fd2708 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.689745:0:19442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79000/0x8475908e9fd2708 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.689828:0:19442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330395.689906:0:19442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed06a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+23:2412:x1875199766173568:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 2543us (8249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330395.689917:0:19442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 18 00010000:00010000:3.0:1788330395.691027:0:17104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79000/0x8475908e9fd2708 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.691042:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79000/0x8475908e9fd2708 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330395.691070:0:17104:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788330395.691928:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2701 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106335 expref: 24 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.691959:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79000/0x8475908e9fd2708 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106335 expref: 23 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.691968:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:3.0:1788330395.691971:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788330395.691975:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79000, rc 0) 00000100:00100000:3.0:1788330395.692259:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+23:15659:x1875199766173312:12345-192.168.202.50@tcp:101:dd.0 Request processed in 22647us (22989us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788330395.692269:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 43 00000100:00100000:2.0:1788330395.703542:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330395.703866:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766173696 00000100:00100000:0.0:1788330395.703881:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766173696 00000100:00100000:0.0:1788330395.703956:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:0.0:1788330395.703970:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8450380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+23:15659:x1875199766173696:12345-192.168.202.50@tcp:101:dd.0 00010000:00010000:0.0:1788330395.704004:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330395.704037:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2716 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610633c expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.704086:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd271d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.704105:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd271d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.704120:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd271d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.704296:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd2716 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610633c expref: 25 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.704316:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd271d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610633c expref: 24 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.704332:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:0.0:1788330395.704336:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788330395.704341:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78000, rc 0) 00000100:00100000:0.0:1788330395.704425:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8450380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+24:15659:x1875199766173696:12345-192.168.202.50@tcp:101:dd.0 Request processed in 458us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330395.704434:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 44 00000100:00100000:1.0:1788330395.713312:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330395.713628:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766173952 00000100:00100000:3.0:1788330395.713644:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766173952 00000100:00100000:3.0:1788330395.713718:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 45 00000100:00100000:3.0:1788330395.713732:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+24:15659:x1875199766173952:12345-192.168.202.50@tcp:36:dd.0 00010000:00010000:3.0:1788330395.714061:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd2724 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.714096:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd2724 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.714111:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd2724 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788330395.714352:0:17103:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788330395.714399:0:17103:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000099691eb6 reply state 00000000df5ae8cc transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd2724 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.714413:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd2724 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330395.714422:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:3.0:1788330395.714425:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788330395.714429:0:17103:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788330395.714589:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+27:15659:x1875199766173952:12345-192.168.202.50@tcp:36:dd.0 Request processed in 856us (1289us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788330395.714598:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 45 00000020:00080000:3.0:1788330395.714603:0:17103:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788330395.718241:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330395.718450:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766174080 00000100:00100000:0.0:1788330395.718463:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766174080 00000100:00100000:0.0:1788330395.718550:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 46 00000100:00100000:0.0:1788330395.718562:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+27:15659:x1875199766174080:12345-192.168.202.50@tcp:101:dd.0 00010000:00010000:0.0:1788330395.718596:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330395.718631:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd272b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106343 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.718714:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd272b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106343 expref: 28 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.718732:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd272b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106343 expref: 28 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.718756:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:0.0:1788330395.718759:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788330395.718763:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79800, rc 0) 00000100:00100000:0.0:1788330395.718839:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+28:15659:x1875199766174080:12345-192.168.202.50@tcp:101:dd.0 Request processed in 278us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330395.718846:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 46 00000100:00100000:2.0:1788330395.728416:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330395.728807:0:20133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766174336 00000100:00100000:1.0:1788330395.728822:0:20133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766174336 00000100:00100000:1.0:1788330395.728924:0:20133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:1.0:1788330395.728938:0:20133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8452680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:99dd523a-1cb7-4908-afb4-ee09ad740fbd+28:15659:x1875199766174336:12345-192.168.202.50@tcp:103:dd.0 00010000:00010000:1.0:1788330395.728957:0:20133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330395.728989:0:20133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd272b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106343 expref: 28 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330395.729012:0:20133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:1.0:1788330395.729018:0:20133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330395.729090:0:20133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8452680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:99dd523a-1cb7-4908-afb4-ee09ad740fbd+27:15659:x1875199766174336:12345-192.168.202.50@tcp:103:dd.0 Request processed in 155us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330395.729098:0:20133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 2 00000100:00100000:1.0:1788330395.731374:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330395.731500:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766174464 00000100:00100000:0.0:1788330395.731514:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766174464 00000100:00100000:0.0:1788330395.731584:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 47 00000100:00100000:0.0:1788330395.731596:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+27:15659:x1875199766174464:12345-192.168.202.50@tcp:58:dd.0 00010000:00010000:0.0:1788330395.731753:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd2732 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.731775:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd2732 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.731789:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd2732 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788330395.733777:0:17104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788330395.734076:0:17104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788330395.734307:0:17104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788330395.734744:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+27:15659:x1875199766174464:12345-192.168.202.50@tcp:58:dd.0 Request processed in 3142us (3375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330395.734756:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 47 00000100:00100000:2.0:1788330395.736707:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330395.736913:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766174592 00000100:00100000:0.0:1788330395.736927:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766174592 00000100:00100000:0.0:1788330395.737016:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 48 00000100:00100000:0.0:1788330395.737027:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+27:15659:x1875199766174592:12345-192.168.202.50@tcp:101:dd.0 00010000:00010000:0.0:1788330395.737053:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330395.737079:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78400/0x8475908e9fd2739 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610634a expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.737194:0:17105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd2732 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.737219:0:17105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78400/0x8475908e9fd2739 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610634a expref: 28 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.737240:0:17105:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd2732 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.737251:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78400/0x8475908e9fd2739 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610634a expref: 28 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.737264:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:0.0:1788330395.737266:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788330395.737269:0:17105:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78400/0x8475908e9fd2739 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610634a expref: 28 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330395.737274:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e78400, rc 0) 00000100:00100000:0.0:1788330395.737347:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+28:15659:x1875199766174592:12345-192.168.202.50@tcp:101:dd.0 Request processed in 321us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330395.737354:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 48 00010000:00010000:0.0:1788330396.254048:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330396.572111:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788330396.572183:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792476544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330396.572292:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330396.573115:0:18615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792476544 00000100:00100000:0.0:1788330396.573130:0:18615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792476544 00000100:00100000:0.0:1788330396.573257:0:18615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788330396.573272:0:18615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792476544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788330396.573313:0:18615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788330396.573397:0:18615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792476544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330396.573405:0:18615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788330396.573507:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792476544:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788330396.574098:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788330396.699472:0:17139:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788330396.699488:0:17139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788330396.699528:0:17139:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788330396.699540:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788330396.699740:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17139:1875199792476672:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788330396.700083:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eee73336c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330396.704763:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330396.705243:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766174720 00000100:00100000:3.0:1788330396.705258:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766174720 00000100:00100000:3.0:1788330396.705375:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 49 00000100:00100000:3.0:1788330396.705388:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+29:15660:x1875199766174720:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788330396.705446:0:17103:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00080000:2.0:1788330396.705511:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330396.705735:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+29:15660:x1875199766174720:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 348us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330396.705765:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 49 00000100:00100000:1.0:1788330396.705839:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17139:1875199792476672:192.168.202.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788330396.709797:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330396.710076:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766174848 00000100:00100000:3.0:1788330396.710091:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766174848 00000100:00100000:3.0:1788330396.710219:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 50 00000100:00100000:3.0:1788330396.710233:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+28:15660:x1875199766174848:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788330396.710342:0:18635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd2740 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710375:0:18635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd2740 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710392:0:18635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd2740 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710415:0:18635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd2747 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710440:0:18635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd2747 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710447:0:18635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd2747 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710706:0:18635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd274e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710718:0:18635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd274e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710725:0:18635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd274e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330396.710800:0:18635:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788330396.710805:0:18635:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788330396.710824:0:18635:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd274e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710839:0:18635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd2740 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710846:0:18635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd2740 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710854:0:18635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd2740 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710860:0:18635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91ac00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330396.710865:0:18635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd2740 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710874:0:18635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd2740 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710890:0:18635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99edc10b5400) 00010000:00010000:3.0:1788330396.710893:0:18635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330396.710900:0:18635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd2740 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710907:0:18635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91ac00/0x8475908e9fd2740 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710921:0:18635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd2747 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710942:0:18635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd2747 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710948:0:18635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd2747 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710953:0:18635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec1327400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330396.710956:0:18635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd2747 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710962:0:18635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd2747 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710969:0:18635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff99eecd8cb600) 00010000:00010000:3.0:1788330396.710972:0:18635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330396.710974:0:18635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd2747 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710980:0:18635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd2747 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.710997:0:18635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd274e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.711016:0:18635:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd274e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.711021:0:18635:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd274e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.711026:0:18635:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147b800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330396.711035:0:18635:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd274e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.711042:0:18635:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd274e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.711051:0:18635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:3.0:1788330396.711053:0:18635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330396.711056:0:18635:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd274e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.711063:0:18635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd274e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330396.711271:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+28:15660:x1875199766174848:12345-192.168.202.50@tcp:34:lhsmtool_posix.0 Request processed in 1039us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330396.711281:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 50 00000100:00100000:0.0:1788330396.715850:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330396.715940:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766175104 00000100:00100000:3.0:1788330396.715956:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766175104 00000100:00100000:3.0:1788330396.716337:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:3.0:1788330396.716350:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+28:15660:x1875199766175104:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330396.716394:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330396.716439:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ba00/0x8475908e9fd2755 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106351 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.716606:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ae00/0x8475908e9fd275c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.716627:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ae00/0x8475908e9fd275c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.716655:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ae00/0x8475908e9fd275c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330396.716669:0:17104:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788330396.716771:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ae00/0x8475908e9fd275c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.716779:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ae00/0x8475908e9fd275c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.716786:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ae00/0x8475908e9fd275c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.716792:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec147ae00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330396.716797:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ae00/0x8475908e9fd275c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.716805:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ae00/0x8475908e9fd275c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.716818:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:3.0:1788330396.716821:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788330396.716825:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ae00/0x8475908e9fd275c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.716832:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ae00/0x8475908e9fd275c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.716885:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ba00/0x8475908e9fd2755 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106351 expref: 30 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.716909:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99edc10b5400) 00010000:00010000:3.0:1788330396.716912:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788330396.716918:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ba00/0x8475908e9fd2755 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106351 expref: 30 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.716929:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147ba00, rc 0) 00000100:00100000:3.0:1788330396.717040:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+29:15660:x1875199766175104:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 691us (1204us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1788330396.717048:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 51 00000100:00100000:2.0:1788330396.720701:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330396.720861:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766175232 00000100:00100000:0.0:1788330396.720874:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766175232 00000100:00100000:0.0:1788330396.720951:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:0.0:1788330396.720965:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc70fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+29:15660:x1875199766175232:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788330396.721019:0:17105:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788330396.721246:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc70fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+29:15660:x1875199766175232:12345-192.168.202.50@tcp:53:lhsmtool_posix.0 Request processed in 283us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330396.721255:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 52 00000100:00100000:0.0:1788330396.725279:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330396.725437:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766175488 00000100:00100000:3.0:1788330396.725452:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766175488 00000100:00100000:3.0:1788330396.725545:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:3.0:1788330396.725559:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc779ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+29:15660:x1875199766175488:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330396.725599:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330396.725632:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd276a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106358 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788330396.726920:0:17104:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:3.0:1788330396.726938:0:17104:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:3.0:1788330396.726960:0:17104:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:3.0:1788330396.727227:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147a800/0x8475908e9fd2771 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.727249:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147a800/0x8475908e9fd2771 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.727265:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147a800/0x8475908e9fd2771 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.727358:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd276a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106358 expref: 32 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.727392:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147a800/0x8475908e9fd2771 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106358 expref: 31 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.727402:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99eecd8cb600) 00010000:00010000:3.0:1788330396.727404:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788330396.727408:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147a800, rc 0) 00000100:00100000:3.0:1788330396.727535:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc779ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+31:15660:x1875199766175488:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 1978us (2268us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1788330396.727547:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 53 00000100:00100000:2.0:1788330396.732775:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330396.732937:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766175744 00000100:00100000:0.0:1788330396.732951:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766175744 00000100:00100000:0.0:1788330396.733038:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 54 00000100:00100000:0.0:1788330396.733052:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+31:15660:x1875199766175744:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788330396.733135:0:17105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330396.733320:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147a800/0x8475908e9fd2771 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106358 expref: 31 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.733345:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99eecd8cb600) 00010000:00010000:0.0:1788330396.733359:0:17105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330396.733390:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd277f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.733407:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd277f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.733418:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd277f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.733461:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2786 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf8b13c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.733655:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2786 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf8b13c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.733663:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2786 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf8b13c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.733736:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd277f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.733744:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd277f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.733751:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd277f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.733758:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330396.733764:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd277f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.733772:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd277f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.733781:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99eecd8cb800) 00010000:00010000:0.0:1788330396.733784:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330396.733788:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd277f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.733794:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd277f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.733812:0:17105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2786 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf8b13c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.733818:0:17105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2786 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf8b13c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.733825:0:17105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2786 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf8b13c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.733830:0:17105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:0.0:1788330396.733833:0:17105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2786 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf8b13c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.733839:0:17105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2786 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf8b13c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.733848:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xf8b13c6 (ffff99eec9a8d000) 00010000:00010000:0.0:1788330396.733850:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330396.733853:0:17105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2786 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf8b13c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.733858:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79600/0x8475908e9fd2786 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf8b13c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330396.734036:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+30:15660:x1875199766175744:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 983us (1272us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788330396.734043:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 54 00000100:00100000:1.0:1788330396.741833:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330396.741951:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766175872 00000100:00100000:3.0:1788330396.741966:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766175872 00000100:00100000:3.0:1788330396.742713:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00100000:3.0:1788330396.742732:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+30:15660:x1875199766175872:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330396.742762:0:17104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330396.742794:0:17104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b000/0x8475908e9fd278d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610635f expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.742843:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd2794 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.742861:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd2794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.742875:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd2794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.743675:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b000/0x8475908e9fd278d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610635f expref: 32 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.743703:0:17104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec1327400/0x8475908e9fd2794 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610635f expref: 31 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.743714:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99eecd8cb200) 00010000:00010000:3.0:1788330396.743717:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788330396.743721:0:17104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec1327400, rc 0) 00000100:00100000:1.0:1788330396.743958:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+31:15660:x1875199766175872:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 1230us (2139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330396.743968:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 55 00000100:00100000:2.0:1788330396.748872:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330396.748977:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766176128 00000100:00100000:3.0:1788330396.748993:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766176128 00000100:00100000:3.0:1788330396.749115:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 56 00000100:00100000:3.0:1788330396.749129:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+31:15660:x1875199766176128:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788330396.749727:0:18635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd279b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.749754:0:18635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd279b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.749787:0:18635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd279b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788330396.750039:0:18635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1788330396.750052:0:18635:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 600721900052ns, next at 601721896943ns, rc = 0 00000004:00010000:2.0:1788330396.750123:0:18635:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004c43aa15 reply state 00000000ec65b56c transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd279b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.750139:0:18635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd279b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.750746:0:18635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99eecd8cb200) 00010000:00010000:2.0:1788330396.750752:0:18635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788330396.750757:0:18635:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330396.750917:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+33:15660:x1875199766176128:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 1786us (2057us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788330396.750926:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 56 00000100:00100000:2.0:1788330396.754522:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330396.754900:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766176256 00000100:00100000:3.0:1788330396.754915:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766176256 00000100:00100000:3.0:1788330396.755002:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00100000:3.0:1788330396.755016:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+33:15660:x1875199766176256:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330396.755055:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330396.755083:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd27a2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106366 expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.755274:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd27a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106366 expref: 34 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.755295:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd27a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106366 expref: 34 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.755344:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99eecd8cb200) 00010000:00010000:3.0:1788330396.755348:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788330396.755353:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147b800, rc 0) 00000100:00100000:3.0:1788330396.755727:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+34:15660:x1875199766176256:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 711us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330396.755737:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 57 00000100:00100000:3.0:1788330396.759628:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330396.759807:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766176384 00000100:00100000:2.0:1788330396.759823:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766176384 00000100:00100000:2.0:1788330396.759932:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:2.0:1788330396.759946:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2412:x1875199766176384:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788330396.760368:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:2412:x1875199766176384:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 423us (759us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788330396.760378:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00080000:3.0:1788330396.761597:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788330396.764379:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330396.764611:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766176640 00000100:00100000:0.0:1788330396.764625:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766176640 00000100:00100000:0.0:1788330396.764701:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:0.0:1788330396.764728:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+34:15660:x1875199766176640:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788330396.765043:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+35:15660:x1875199766176640:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 317us (687us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788330396.765052:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 9 00000100:00100000:1.0:1788330396.768055:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330396.768678:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766176896 00000100:00100000:0.0:1788330396.768692:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766176896 00000100:00100000:0.0:1788330396.768779:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 58 00000100:00100000:0.0:1788330396.768792:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+35:15660:x1875199766176896:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788330396.768980:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+35:15660:x1875199766176896:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 190us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330396.768989:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 58 00000100:00100000:1.0:1788330396.773093:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330396.773297:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766177024 00000100:00100000:3.0:1788330396.773313:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766177024 00000100:00100000:3.0:1788330396.773398:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00100000:3.0:1788330396.773410:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+35:15660:x1875199766177024:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330396.773456:0:17103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330396.773504:0:17103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b000/0x8475908e9fd27a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610636d expref: -99 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.773614:0:17103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ba00/0x8475908e9fd27b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.773633:0:17103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ba00/0x8475908e9fd27b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.773649:0:17103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ba00/0x8475908e9fd27b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330396.773707:0:17103:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788330396.773734:0:17103:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ba00/0x8475908e9fd27b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.773785:0:17103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b000/0x8475908e9fd27a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610636d expref: 37 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.773808:0:17103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ba00/0x8475908e9fd27b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610636d expref: 36 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.773818:0:17103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99eecd8cb200) 00010000:00010000:3.0:1788330396.773821:0:17103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788330396.773825:0:17103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147ba00, rc 0) 00000100:00100000:3.0:1788330396.773919:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+36:15660:x1875199766177024:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 510us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330396.773928:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 59 00000100:00100000:3.0:1788330396.779013:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330396.779774:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766177152 00000100:00100000:0.0:1788330396.780003:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766177152 00000100:00100000:0.0:1788330396.780143:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:0.0:1788330396.780191:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+6:2412:x1875199766177152:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330396.780219:0:18612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330396.780249:0:18612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd27b7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c6106374 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788330396.780286:0:18612:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a97c19c, blocks: 0x0 00010000:00010000:0.0:1788330396.780314:0:18612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=600s v=(0 0) 00010000:00010000:0.0:1788330396.780321:0:18612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330396.780332:0:18612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd27b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106374 expref: 7 pid: 18612 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.780388:0:18612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd27b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106374 expref: 7 pid: 18612 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.780407:0:18612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eef6e79600, rc 0) 00000100:00100000:0.0:1788330396.780525:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+7:2412:x1875199766177152:12345-192.168.202.50@tcp:101:lhsmtool_posix.0 Request processed in 337us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330396.780533:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 28 00000100:00100000:1.0:1788330396.784122:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330396.784329:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766177408 00000100:00100000:3.0:1788330396.784345:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766177408 00000100:00100000:3.0:1788330396.784445:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 60 00000100:00100000:3.0:1788330396.784458:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+36:15660:x1875199766177408:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788330396.784882:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+36:15660:x1875199766177408:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 425us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330396.784891:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 60 00000100:00100000:1.0:1788330396.788102:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330396.788340:0:17103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766177536 00000100:00100000:3.0:1788330396.788354:0:17103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766177536 00000100:00100000:3.0:1788330396.788445:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:3.0:1788330396.788459:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+36:15660:x1875199766177536:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788330396.800543:0:17083:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1788330396.800570:0:17083:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1788330396.800764:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b800/0x8475908e9fd25f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800791:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b800/0x8475908e9fd25f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800798:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b800/0x8475908e9fd25f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800803:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91b800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330396.800808:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b800/0x8475908e9fd25f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800814:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b800/0x8475908e9fd25f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800837:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99eecd8cbb00) 00010000:00010000:2.0:1788330396.800840:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330396.800846:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b800/0x8475908e9fd25f0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800852:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b800/0x8475908e9fd25f0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800880:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b600/0x8475908e9fd25f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800886:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b600/0x8475908e9fd25f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800893:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b600/0x8475908e9fd25f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800898:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91b600 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330396.800907:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b600/0x8475908e9fd25f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800913:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b600/0x8475908e9fd25f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800921:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99eecd8cb800) 00010000:00010000:2.0:1788330396.800924:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330396.800927:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b600/0x8475908e9fd25f7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800933:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91b600/0x8475908e9fd25f7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800949:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd269f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800955:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd269f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800958:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd269f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800961:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91bc00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330396.800963:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd269f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800966:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd269f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800972:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff99eecd8cbf00) 00010000:00010000:2.0:1788330396.800974:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330396.800981:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd269f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800985:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91bc00/0x8475908e9fd269f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800996:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd2724 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.800999:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd2724 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.801003:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd2724 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.801007:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eeef91aa00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330396.801008:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd2724 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.801011:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd2724 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.801016:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:2.0:1788330396.801017:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330396.801019:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd2724 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.801022:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eeef91aa00/0x8475908e9fd2724 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.801031:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd279b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.801034:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd279b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.801041:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd279b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.801044:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039000 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:2.0:1788330396.801046:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd279b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.801049:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd279b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.801054:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99eecd8cb200) 00010000:00010000:2.0:1788330396.801055:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788330396.801057:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd279b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.801060:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd279b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788330396.807390:0:17083:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:3.0:1788330396.807605:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2644 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.807636:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2644 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.807644:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2644 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.807649:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e78800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:3.0:1788330396.807654:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2644 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.807662:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2644 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.807682:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99eecd8cb800) 00010000:00010000:3.0:1788330396.807685:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788330396.807690:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2644 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.807696:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78800/0x8475908e9fd2644 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330396.807749:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+15:15660:x1875199766177536:12345-192.168.202.50@tcp:44:lhsmtool_posix.0 Request processed in 19283us (19656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330396.807761:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 61 00000100:00100000:3.0:1788330396.808387:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eefd32d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792476800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788330396.808484:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330396.809399:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792476800 00000100:00100000:0.0:1788330396.809413:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792476800 00000100:00100000:0.0:1788330396.809524:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788330396.809537:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875199792476800:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1788330396.809722:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1788330396.809722:0:18610:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788330396.809726:0:18610:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788330396.809729:0:18610:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788330396.809731:0:18610:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788330396 -> 1788330396 00002000:00010000:0.0:1788330396.809734:0:18610:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788330396.809821:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875199792476800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 287us (1336us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788330396.809828:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1788330396.809991:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99eefd32d500/2, rc 0, transno 8589934596 00000100:00100000:3.0:1788330396.810001:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eefd32d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875199792476800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788330396.810750:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330396.810790:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766177664 00000100:00100000:2.0:1788330396.810800:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766177664 00000100:00100000:2.0:1788330396.810891:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:2.0:1788330396.810902:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec9779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+7:2412:x1875199766177664:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788330396.811037:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec9779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+7:2412:x1875199766177664:12345-192.168.202.50@tcp:16:lhsmtool_posix.0 Request processed in 137us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330396.811045:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 30 00000100:00100000:1.0:1788330396.812829:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330396.812939:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766177920 00000100:00100000:3.0:1788330396.812953:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766177920 00000100:00100000:3.0:1788330396.813032:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 62 00000100:00100000:3.0:1788330396.813046:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+15:15660:x1875199766177920:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788330396.813130:0:17105:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330396.813197:0:17105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ba00/0x8475908e9fd27b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610636d expref: 15 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.813222:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99eecd8cb200) 00010000:00010000:3.0:1788330396.813228:0:17105:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330396.813317:0:17105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd27be lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.813335:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd27be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.813355:0:17105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd27be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330396.813727:0:17105:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001531231e reply state 0000000032d2794b transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd27be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.813739:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec9039000/0x8475908e9fd27be lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17105 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.813743:0:17105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99eecd8cb200) 00010000:00010000:2.0:1788330396.813746:0:17105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788330396.813748:0:17105:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330396.813870:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99dd523a-1cb7-4908-afb4-ee09ad740fbd+16:15660:x1875199766177920:12345-192.168.202.50@tcp:36:lhsmtool_posix.0 Request processed in 827us (1051us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788330396.813879:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 62 00000100:00100000:1.0:1788330396.815839:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330396.815964:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766178048 00000100:00100000:0.0:1788330396.815976:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766178048 00000100:00100000:0.0:1788330396.816042:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:0.0:1788330396.816064:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+7:2412:x1875199766178048:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788330396.816735:0:18610:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788330396.816739:0:18610:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788330395 00002000:00010000:0.0:1788330396.816741:0:18610:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788330395 00002000:00010000:0.0:1788330396.816742:0:18610:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788330396 -> 1788330395 00002000:00010000:0.0:1788330396.816744:0:18610:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788330396.816850:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+8:2412:x1875199766178048:12345-192.168.202.50@tcp:2:lhsmtool_posix.0 Request processed in 785us (1024us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788330396.816859:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 31 00000100:00100000:3.0:1788330396.818759:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330396.818866:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766178176 00000100:00100000:0.0:1788330396.818878:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766178176 00000100:00100000:0.0:1788330396.818944:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:0.0:1788330396.818956:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+8:2410:x1875199766178176:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788330396.819016:0:18612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000016983baa/0x8475908e9fd27c5 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.819036:0:18612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330396.819041:0:18612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330396.819048:0:18612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016983baa/0x8475908e9fd27c5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.819066:0:18612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016983baa/0x8475908e9fd27c5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.819096:0:18612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000016983baa/0x8475908e9fd27c5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.819125:0:18612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016983baa/0x8475908e9fd27c5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.819133:0:18612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016983baa/0x8475908e9fd27c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.819138:0:18612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79800 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330396.819142:0:18612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016983baa/0x8475908e9fd27c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.819173:0:18612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016983baa/0x8475908e9fd27c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.819187:0:18612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016983baa/0x8475908e9fd27c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.819192:0:18612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016983baa/0x8475908e9fd27c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330396.819266:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+8:2410:x1875199766178176:12345-192.168.202.50@tcp:1:lhsmtool_posix.0 Request processed in 313us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330396.819270:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 32 00000100:00100000:1.0:1788330396.821567:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330396.821650:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766178432 00000100:00100000:0.0:1788330396.821661:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766178432 00000100:00100000:0.0:1788330396.821721:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 63 00000100:00100000:0.0:1788330396.821746:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+16:15660:x1875199766178432:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788330396.822028:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd27cc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.822046:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd271d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610633c expref: 16 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.822054:0:17104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd27cc lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.822094:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd271d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610633c expref: 16 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.822109:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd271d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610633c expref: 16 pid: 17105 timeout: 700 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330396.822127:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17104:1875199792476928:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330396.822336:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeded4b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330396.825369:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330396.825527:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17104:1875199792476928:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330396.825562:0:17104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd27cc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330396.825824:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766178560 00000100:00100000:2.0:1788330396.825834:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766178560 00010000:00010000:2.0:1788330396.825892:0:17089:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd271d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610633c expref: 17 pid: 17105 timeout: 700 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330396.825982:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 19 00000100:00100000:2.0:1788330396.825992:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+17:2413:x1875199766178560:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330396.826009:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330396.826016:0:17089:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd271d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610633c expref: 17 pid: 17105 timeout: 700 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.826027:0:17089:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd271d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610633c expref: 17 pid: 17105 timeout: 700 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.826067:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78000/0x8475908e9fd271d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610633c expref: 17 pid: 17105 timeout: 700 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.826083:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:2.0:1788330396.826089:0:17089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78400/0x8475908e9fd2739 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610634a expref: 16 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.826099:0:17089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd27cc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.826108:0:17089:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd27cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.826116:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd27cc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330396.826147:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330396.826243:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+16:2413:x1875199766178560:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 252us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330396.826249:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 19 00010000:00010000:0.0:1788330396.826801:0:17104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd27cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.826807:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd27cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.827090:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd27d3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.827113:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd27a2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106366 expref: 16 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.827123:0:17104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd27d3 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.827188:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd27a2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106366 expref: 16 pid: 17103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.827200:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd27a2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106366 expref: 16 pid: 17103 timeout: 700 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330396.827212:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc779a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17104:1875199792477056:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330396.827300:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99eeded4b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788330396.830826:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330396.830945:0:19442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766178688 00000100:00100000:0.0:1788330396.830959:0:19442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766178688 00010000:00010000:0.0:1788330396.831006:0:19442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd27a2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106366 expref: 17 pid: 17103 timeout: 700 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330396.831046:0:19442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 20 00000100:00100000:0.0:1788330396.831055:0:19442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec977bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+17:2412:x1875199766178688:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330396.831069:0:19442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330396.831076:0:19442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd27a2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106366 expref: 17 pid: 17103 timeout: 700 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.831090:0:19442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd27a2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106366 expref: 17 pid: 17103 timeout: 700 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.831128:0:19442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99eecd8cb200) 00010000:00010000:0.0:1788330396.831134:0:19442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd27d3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.831145:0:19442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd27d3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.831177:0:19442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd27d3 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.831198:0:19442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330396.831254:0:19442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec977bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+17:2412:x1875199766178688:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 201us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330396.831260:0:19442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 20 00010000:00010000:1.0:1788330396.832899:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b800/0x8475908e9fd27a2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106366 expref: 16 pid: 17103 timeout: 700 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330396.832936:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc779a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17104:1875199792477056:192.168.202.50@tcp:104: 00010000:00010000:1.0:1788330396.832973:0:17104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd27d3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.833002:0:17104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd27d3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.833006:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd27d3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788330396.833339:0:17104:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788330396.833610:0:17104:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788330396.833643:0:17104:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788330396.833737:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17104:1875199792477184:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788330396.833809:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330396.833866:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330396.834035:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792477184 00000100:00100000:2.0:1788330396.834044:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792477184 00000100:00100000:2.0:1788330396.834110:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788330396.834122:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17104:x1875199792477184:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788330396.834235:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17104:x1875199792477184:12345-0@lo:1000:mdt00_001.0 Request processed in 116us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330396.834241:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788330396.834420:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17104:1875199792477184:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788330396.834767:0:17104:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1788330396.834817:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17104:1875199792477312:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788330396.834849:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330396.834885:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788330396.834943:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792477312 00000100:00100000:2.0:1788330396.834949:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792477312 00000100:00100000:2.0:1788330396.835013:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788330396.835019:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17104:x1875199792477312:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788330396.835131:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17104:x1875199792477312:12345-0@lo:1000:mdt00_001.0 Request processed in 111us (282us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788330396.835139:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788330396.835220:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17104:1875199792477312:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788330396.835255:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd27d3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.835263:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd27d3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.835268:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd27d3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.835272:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79800 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330396.835285:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd27d3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.835292:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd27d3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.835309:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99eecd8cb200) 00010000:00010000:1.0:1788330396.835311:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330396.835315:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd27d3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.835320:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79800/0x8475908e9fd27d3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.835349:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd2732 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.835353:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd2732 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.835356:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd2732 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.835361:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79c00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330396.835363:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd2732 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.835370:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd2732 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.835378:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:1.0:1788330396.835380:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330396.835393:0:17104:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78400/0x8475908e9fd2739 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610634a expref: 19 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.835406:0:17104:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78400/0x8475908e9fd2739 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610634a expref: 19 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.835417:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78400/0x8475908e9fd2739 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610634a expref: 19 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.835495:0:17104:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e78400/0x8475908e9fd2739 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610634a expref: 19 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330396.835506:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17104:1875199792477440:192.168.202.50@tcp:105: 00000100:00100000:1.0:1788330396.835659:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc665cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788330396.838787:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330396.838855:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766178816 00000100:00100000:2.0:1788330396.838868:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766178816 00000100:00100000:2.0:1788330396.838939:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:2.0:1788330396.838951:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eec53d1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+20:15659:x1875199766178816:12345-192.168.202.50@tcp:49:dd.0 00000100:00100000:2.0:1788330396.839115:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eec53d1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+20:15659:x1875199766178816:12345-192.168.202.50@tcp:49:dd.0 Request processed in 166us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330396.839123:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 10 00000100:00100000:2.0:1788330396.842243:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:3.0:1788330396.842402:0:18635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766178944 00000100:00100000:3.0:1788330396.842416:0:18635:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766178944 00000100:00100000:3.0:1788330396.842506:0:18635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 64 00000100:00100000:3.0:1788330396.842522:0:18635:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+20:15659:x1875199766178944:12345-192.168.202.50@tcp:101:dd.0 00010000:00010000:3.0:1788330396.842559:0:18635:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330396.842592:0:18635:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ba00/0x8475908e9fd27da lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae56dfa2c610637b expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.842651:0:18635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b000/0x8475908e9fd27e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.842668:0:18635:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd27cc lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.842677:0:18635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b000/0x8475908e9fd27e1 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.842700:0:18635:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd27cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.842733:0:18635:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b000/0x8475908e9fd27e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330396.843084:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17104:1875199792477440:192.168.202.50@tcp:105: 00010000:00010000:1.0:1788330396.843115:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd2732 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843125:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79c00/0x8475908e9fd2732 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843179:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd27e8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843190:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd27e8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843202:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd27e8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843225:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd27e8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843232:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd27e8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843238:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd27e8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843245:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eefe7ee400 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330396.843248:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd27e8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843257:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd27e8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843273:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:1.0:1788330396.843276:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330396.843280:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd27e8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843287:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eefe7ee400/0x8475908e9fd27e8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843298:0:17104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd27cc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843304:0:17104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd27cc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843310:0:17104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd27cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843322:0:17104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79e00 already unused, calling callback (ffffffffc1aff4f0) 00010000:00010000:1.0:1788330396.843326:0:17104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd27cc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843332:0:17104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd27cc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843341:0:17104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:1.0:1788330396.843344:0:17104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788330396.843347:0:17104:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b000/0x8475908e9fd27e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843354:0:17104:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b000/0x8475908e9fd27e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843361:0:17104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b000/0x8475908e9fd27e1 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843387:0:17104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd27cc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.843394:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79e00/0x8475908e9fd27cc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 17104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.843628:0:18635:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b000/0x8475908e9fd27e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.843635:0:18635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b000/0x8475908e9fd27e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18635 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.843777:0:18635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147ba00/0x8475908e9fd27da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610637b expref: 22 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.843793:0:18635:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99eec147b000/0x8475908e9fd27e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c610637b expref: 21 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330396.843800:0:18635:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99eecd8cb100) 00010000:00010000:3.0:1788330396.843803:0:18635:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788330396.843806:0:18635:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99eec147b000, rc 0) 00000100:00100000:3.0:1788330396.843902:0:18635:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+21:15659:x1875199766178944:12345-192.168.202.50@tcp:101:dd.0 Request processed in 1383us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330396.843911:0:18635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 64 00000100:00100000:1.0:1788330396.844556:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+20:15660:x1875199766178432:12345-192.168.202.50@tcp:57:lhsmtool_posix.0 Request processed in 22808us (22997us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788330396.844568:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 63 00000020:00080000:1.0:1788330396.844572:0:17104:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788330396.846599:0:17139:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788330396.846612:0:17139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788330396.846639:0:17139:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788330396.846646:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788330396.849398:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330396.849724:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766179200 00000100:00100000:0.0:1788330396.849743:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766179200 00000100:00100000:0.0:1788330396.849830:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 11 00000100:00100000:0.0:1788330396.849844:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+20:15660:x1875199766179200:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788330396.850285:0:17107:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788330396.850328:0:17107:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788330396.850385:0:17107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd27ef lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.850436:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd27ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.850452:0:17107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd27ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.850585:0:17107:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd27ef lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.850755:0:17107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd27ef lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.850763:0:17107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd27ef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330396.850791:0:17107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788330396.850935:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+22:15660:x1875199766179200:12345-192.168.202.50@tcp:35:lhsmtool_posix.0 Request processed in 1090us (1549us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788330396.850946:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 11 00000020:00080000:0.0:1788330396.850953:0:17107:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788330396.851069:0:17092:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330396.851078:0:17092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd27ef lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.851094:0:17092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330396.851099:0:17092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd27ef lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.851106:0:17092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd27ef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.851123:0:17092:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99eecd8cb200) 00010000:00010000:1.0:1788330396.851126:0:17092:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788330396.851133:0:17092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd27ef lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.851138:0:17092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99eef6e79400/0x8475908e9fd27ef lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17107 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330396.851183:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330396.851186:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330396.851188:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330397.043239:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330397.043569:0:18616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766179328 00000100:00100000:0.0:1788330397.043584:0:18616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766179328 00000100:00100000:0.0:1788330397.043689:0:18616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 0 00000100:00100000:0.0:1788330397.043703:0:18616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eefd32c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+8:2411:x1875199766179328:12345-192.168.202.50@tcp:4:dd.0 00010000:00010000:0.0:1788330397.043753:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd27f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330397.043781:0:18616:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd27b7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106374 expref: 8 pid: 18612 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330397.043811:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788330397.043816:0:18616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330397.043822:0:18616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd27f6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330397.043881:0:18616:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd27b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106374 expref: 8 pid: 18612 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330397.043899:0:18616:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd27b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106374 expref: 8 pid: 18612 timeout: 701 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330397.043917:0:18616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7799c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18616:1875199792477568:192.168.202.50@tcp:104: 00000100:00100000:0.0:1788330397.044030:0:18616:0:(client.c:2715:ptlrpc_set_wait()) set ffff99edc6627540 going to sleep for 11 seconds 00000100:00100000:2.0:1788330397.051229:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330397.052009:0:18618:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788330397.052025:0:18618:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788330397.053370:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766179456 00000100:00100000:1.0:1788330397.053389:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766179456 00000100:00100000:2.0:1788330397.056051:0:20247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 1 00000100:00100000:2.0:1788330397.056081:0:20247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+9:2411:x1875199766179456:12345-192.168.202.50@tcp:4:dd.0 00010000:00010000:2.0:1788330397.056142:0:20247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b18a6de4/0x8475908e9fd27fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330397.057577:0:18616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7799c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18616:1875199792477568:192.168.202.50@tcp:104: 00010000:00010000:0.0:1788330397.057646:0:18616:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd27f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330397.058772:0:20247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330397.058778:0:20247:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330397.059144:0:20247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b18a6de4/0x8475908e9fd27fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330397.059270:0:20247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b18a6de4/0x8475908e9fd27fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330397.062326:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:0.0:1788330397.062484:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766179584 00000100:00100000:0.0:1788330397.062512:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766179584 00010000:00010000:0.0:1788330397.062574:0:17088:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd27b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106374 expref: 10 pid: 18612 timeout: 701 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330397.062640:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 21 00000100:00100000:0.0:1788330397.062653:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+10:2413:x1875199766179584:12345-192.168.202.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330397.062689:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330397.062722:0:17088:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd27b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106374 expref: 10 pid: 18612 timeout: 701 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330397.062739:0:17088:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd27b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106374 expref: 10 pid: 18612 timeout: 701 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330397.062775:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000050862e4/0x8475908e9fd27b7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.50@tcp remote: 0xae56dfa2c6106374 expref: 10 pid: 18612 timeout: 701 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330397.062809:0:17088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330397.062814:0:17088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330397.062823:0:17088:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd27f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330397.062842:0:17088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd27f6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330397.062853:0:17088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330397.062856:0:17088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330397.062861:0:17088:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b18a6de4/0x8475908e9fd27fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330397.062866:0:17088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b18a6de4/0x8475908e9fd27fd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330397.062921:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330397.063008:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+9:2413:x1875199766179584:12345-192.168.202.50@tcp:103:ldlm_bl.0 Request processed in 356us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330397.063016:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 21 00010000:00010000:1.0:1788330397.063461:0:18616:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd27f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330397.063472:0:18616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd27f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330397.067481:0:20247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b18a6de4/0x8475908e9fd27fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330397.067520:0:20247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b18a6de4/0x8475908e9fd27fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330397.083915:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eed82d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792477696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330397.084043:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330397.084393:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792477824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788330397.084445:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330397.084539:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792478336:0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.084559:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792477952:0@lo:400:kworker.0 00000100:00100000:2.0:1788330397.084596:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330397.084611:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330397.084625:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792478848:0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.084650:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792478464:0@lo:400:kworker.0 00000100:00100000:2.0:1788330397.084657:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330397.084683:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792479360:0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.084688:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330397.084717:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792478976:0@lo:400:kworker.0 00000100:00100000:2.0:1788330397.084720:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330397.084749:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330397.084752:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788330397.084762:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792478208:0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.084775:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788330397.084783:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792478080:0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.084808:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330397.084824:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792478592:0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.084846:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330397.084865:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792479104:0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.084885:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330397.084916:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792477952 00000100:00100000:1.0:1788330397.084932:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792477952 00000100:00100000:2.0:1788330397.084944:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330397.084970:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792478720:0@lo:400:kworker.0 00000100:00100000:2.0:1788330397.084993:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330397.084998:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788330397.085011:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:3646:x1875199792477952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330397.085021:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792479232:0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.085075:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6efb806c-ba9f-4d20-bba3-c0a9c1d82585+24:3646:x1875199792477952:12345-0@lo:400:kworker.0 Request processed in 67us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330397.085082:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788330397.085120:0:19787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792478464 00000100:00100000:1.0:1788330397.085124:0:19787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792478464 00000100:00100000:1.0:1788330397.085148:0:19787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792478080 00000100:00100000:1.0:1788330397.085187:0:19787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792478080 00000100:00100000:1.0:1788330397.085205:0:19787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788330397.085219:0:19787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792478464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.085256:0:19787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792478464:12345-0@lo:400:kworker.0 Request processed in 39us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330397.085262:0:19787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788330397.085275:0:19787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788330397.085293:0:19787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792478080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.085320:0:19787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792478080:12345-0@lo:400:kworker.0 Request processed in 28us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330397.085325:0:19787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788330397.085374:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792478080:0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.085385:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6efb806c-ba9f-4d20-bba3-c0a9c1d82585:3646:1875199792477952:0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.085393:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792478464:0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.085438:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792478336 00000100:00100000:1.0:1788330397.085442:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792478336 00000100:00100000:1.0:1788330397.085466:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792478848 00000100:00100000:1.0:1788330397.085469:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792478848 00000100:00100000:1.0:1788330397.085479:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792479360 00000100:00100000:1.0:1788330397.085481:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792479360 00000100:00080000:1.0:1788330397.085508:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788330397.085524:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792478976 00000100:00100000:1.0:1788330397.085527:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792478976 00000100:00080000:1.0:1788330397.085539:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330397.085551:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792479104 00000100:00100000:1.0:1788330397.085554:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792479104 00000100:00080000:1.0:1788330397.085564:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788330397.085576:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788330397.085582:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792478336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.085626:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875199792478336:12345-0@lo:400:kworker.0 Request processed in 43us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330397.085632:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788330397.085645:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788330397.085651:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792478848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.085694:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875199792478848:12345-0@lo:400:kworker.0 Request processed in 42us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330397.085700:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788330397.085713:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788330397.085719:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875199792479360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.085743:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875199792479360:12345-0@lo:400:kworker.0 Request processed in 25us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330397.085749:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788330397.085759:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788330397.085765:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792478976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.085796:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875199792478976:12345-0@lo:400:kworker.0 Request processed in 31us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330397.085802:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788330397.085826:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875199792478976:0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.085846:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788330397.085852:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792479104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.085884:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875199792479104:12345-0@lo:400:kworker.0 Request processed in 33us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330397.085890:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1788330397.085923:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc18a80 x1875199792479104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330397.085935:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875199792479104:0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.085979:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792478592 00000100:00100000:1.0:1788330397.085983:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792478592 00000100:00100000:1.0:1788330397.086021:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792478208 00000100:00100000:1.0:1788330397.086024:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792478208 00000100:00100000:1.0:1788330397.086037:0:18610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792478720 00000100:00100000:1.0:1788330397.086039:0:18610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792478720 00000100:00100000:1.0:1788330397.086055:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788330397.086061:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792478592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.086100:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792478592:12345-0@lo:400:kworker.0 Request processed in 39us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330397.086106:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788330397.086117:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330397.086123:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792478208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.086180:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875199792478208:12345-0@lo:400:kworker.0 Request processed in 57us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330397.086187:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330397.086199:0:18610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788330397.086205:0:18610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792478720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.086232:0:18610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792478720:12345-0@lo:400:kworker.0 Request processed in 28us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330397.086238:0:18610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788330397.086252:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788330397.086255:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330397.086272:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792478592:0@lo:400:kworker.0 00000100:00100000:2.0:1788330397.086372:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330397.086412:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875199792478336:0@lo:400:kworker.0 00000100:00100000:2.0:1788330397.086434:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875199792478848:0@lo:400:kworker.0 00010000:00080000:2.0:1788330397.086447:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99eeffc18e00 x1875199792479360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330397.086464:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875199792479360:0@lo:400:kworker.0 00000100:00100000:2.0:1788330397.086488:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875199792478208:0@lo:400:kworker.0 00000100:00100000:2.0:1788330397.086498:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792478720:0@lo:400:kworker.0 00000100:00100000:2.0:1788330397.086529:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792477696 00000100:00100000:2.0:1788330397.086534:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792477696 00000100:00100000:2.0:1788330397.086554:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792477824 00000100:00100000:2.0:1788330397.086557:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792477824 00000100:00100000:2.0:1788330397.086569:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788330397.086575:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875199792477696:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330397.086683:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792479232 00000100:00100000:1.0:1788330397.086688:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792479232 00000100:00080000:1.0:1788330397.086706:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330397.086724:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788330397.086730:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792479232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330397.086771:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875199792479232:12345-0@lo:400:kworker.0 Request processed in 41us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330397.086777:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00002000:00000024:2.0:1788330397.086941:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 34029248 pending 7704576 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788330397.086984:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875199792477696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 407us (2941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330397.086990:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788330397.087005:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788330397.087012:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792477824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788330397.087021:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 34029248 pending 7704576 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788330397.087046:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875199792477824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (2603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330397.087052:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788330397.087131:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eed82d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875199792477696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330397.087265:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875199792479232:0@lo:400:kworker.0 00000100:00100000:2.0:1788330397.087278:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875199792477824:0@lo:13:osp-pre-1-1.0 00000001:00080000:3.0:1788330397.205987:0:19426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1788330397.206016:0:19426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1788330397.206336:0:18616:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1788330397.206343:0:18616:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788330395 -> 1788330396 00002000:00010000:1.0:1788330397.206346:0:18616:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788330395 -> 1788330396 00002000:00010000:1.0:1788330397.206349:0:18616:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1788330397.206374:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd27f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330397.206390:0:18616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd27f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330397.206399:0:18616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd27f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330397.206407:0:18616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eef6e79400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:1.0:1788330397.206413:0:18616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd27f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330397.206434:0:18616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd27f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330397.206494:0:18616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd27f6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330397.206503:0:18616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de5f91aa/0x8475908e9fd27f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330397.207124:0:18616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eefd32c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+7:2411:x1875199766179328:12345-192.168.202.50@tcp:4:dd.0 Request processed in 163412us (163894us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788330397.207138:0:18616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 0 00000001:00080000:3.0:1788330397.247126:0:19426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1788330397.247374:0:20247:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1788330397.247381:0:20247:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1788330397.247401:0:20247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b18a6de4/0x8475908e9fd27fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330397.247415:0:20247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b18a6de4/0x8475908e9fd27fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330397.247437:0:20247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b18a6de4/0x8475908e9fd27fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330397.247446:0:20247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99eec9039400 already unused, calling callback (ffffffffc0ed2230) 00010000:00010000:0.0:1788330397.247452:0:20247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b18a6de4/0x8475908e9fd27fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330397.247462:0:20247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b18a6de4/0x8475908e9fd27fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330397.247486:0:20247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b18a6de4/0x8475908e9fd27fd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330397.247495:0:20247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b18a6de4/0x8475908e9fd27fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330397.247680:0:20247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2411:x1875199766179456:12345-192.168.202.50@tcp:4:dd.0 Request processed in 191600us (196460us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788330397.247704:0:20247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 1 00010000:00010000:0.0:1788330397.275471:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330397.595900:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792479488:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788330397.596008:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330397.596175:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792479488 00000100:00100000:0.0:1788330397.596189:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792479488 00000100:00100000:0.0:1788330397.596256:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788330397.596268:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eeffc1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792479488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788330397.596299:0:18614:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788330397.596360:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eeffc1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792479488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330397.596367:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788330397.597965:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792479488:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1788330397.851483:0:17139:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788330397.851498:0:17139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788330397.851525:0:17139:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788330397.851534:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788330398.300315:0:17858:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330398.619359:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788330398.619393:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99eeffc18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792479744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330398.619515:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330398.619664:0:19787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792479744 00000100:00100000:1.0:1788330398.619674:0:19787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792479744 00000100:00100000:1.0:1788330398.619749:0:19787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788330398.619763:0:19787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792479744:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788330398.619784:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99edc7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792479616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788330398.619815:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1788330398.619817:0:19787:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788330398.619884:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199792479616 00000100:00100000:0.0:1788330398.619889:0:17109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199792479616 00000100:00100000:0.0:1788330398.619929:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788330398.619936:0:17109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99eed82d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792479616:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788330398.619957:0:19787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875199792479744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 197us (442us total) trans 0 rc 0/0 00000004:00000024:0.0:1788330398.619958:0:17109:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788330398.619966:0:19787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788330398.619994:0:17109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99eed82d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875199792479616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330398.620001:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788330398.620089:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99eeffc18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875199792479744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788330398.620102:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99edc7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875199792479616:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1788330398.980081:0:20284:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788330399.323426:0:17092:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330399.462428:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330399.462561:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330399.462611:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330399.462648:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330399.462675:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:2.0:1788330399.462700:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330399.462702:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766179840 00000100:00100000:1.0:1788330399.462719:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766179840 00000100:00100000:2.0:1788330399.462727:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330399.462807:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766180352 00000100:00100000:1.0:1788330399.462812:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766180352 00000100:00100000:2.0:1788330399.462817:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330399.462836:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766180480 00000100:00100000:1.0:1788330399.462840:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766180480 00000100:00100000:2.0:1788330399.462843:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.50@tcp (source: 12345-192.168.202.50@tcp) 00000100:00100000:1.0:1788330399.462862:0:17104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766179968 00000100:00100000:1.0:1788330399.462866:0:17104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766179968 00000100:00100000:2.0:1788330399.462884:0:17103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 72 00000100:00100000:2.0:1788330399.462906:0:17103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+22:2410:x1875199766179840:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:2.0:1788330399.463028:0:17103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99dd523a-1cb7-4908-afb4-ee09ad740fbd+22:2410:x1875199766179840:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 131us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330399.463617:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766180096 00000100:00100000:3.0:1788330399.463624:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766180096 00000100:00100000:3.0:1788330399.463660:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766180608 00000100:00100000:3.0:1788330399.463680:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766180608 00000100:00100000:3.0:1788330399.463699:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766180736 00000100:00100000:3.0:1788330399.463702:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766180736 00000100:00100000:3.0:1788330399.463716:0:18802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766180224 00000100:00100000:3.0:1788330399.463718:0:18802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766180224 00000100:00100000:3.0:1788330399.463734:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:3.0:1788330399.463742:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2410:x1875199766180096:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330399.463799:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8456300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2410:x1875199766180096:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 53us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330399.463806:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 24 00000100:00100000:3.0:1788330399.464413:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:3.0:1788330399.464426:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2410:x1875199766180608:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330399.464467:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2410:x1875199766180608:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 46us (1792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330399.464475:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 25 00000100:00100000:3.0:1788330399.464488:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00100000:3.0:1788330399.464495:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2410:x1875199766180736:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330399.464519:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2410:x1875199766180736:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 24us (1792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330399.464917:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 26 00000100:00100000:3.0:1788330399.464934:0:18802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:3.0:1788330399.464942:0:18802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2411:x1875199766180224:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:3.0:1788330399.464975:0:18802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2411:x1875199766180224:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 34us (2133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330399.464980:0:18802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 27 00000100:00100000:1.0:1788330399.465849:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 73 00000100:00100000:1.0:1788330399.465868:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:2410:x1875199766180352:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330399.465938:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+6:2410:x1875199766180352:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 77us (3289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330399.465947:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 73 00000100:00100000:1.0:1788330399.465969:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 74 00000100:00100000:1.0:1788330399.465978:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2410:x1875199766180480:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330399.466005:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:14374cd5-fe9e-406e-8acf-b98a60f93e29+5:2410:x1875199766180480:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 30us (3305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330399.466012:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 74 00000100:00100000:1.0:1788330399.466025:0:17104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 75 00000100:00100000:1.0:1788330399.466032:0:17104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc8454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2411:x1875199766179968:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:1.0:1788330399.466058:0:17104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc8454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99dd523a-1cb7-4908-afb4-ee09ad740fbd+5:2411:x1875199766179968:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 27us (3246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330399.466064:0:17104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 75 00000100:00080000:1.0:1788330399.466097:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788330399.466104:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788330399.466123:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788330399.466126:0:17099:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330399.468467:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199766179712 00000100:00100000:0.0:1788330399.468491:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199766179712 00000100:00100000:0.0:1788330399.468570:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.50@tcp, seq: 170 00000100:00100000:0.0:1788330399.468873:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99edc7793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:2411:x1875199766179712:12345-192.168.202.50@tcp:400:kworker.0 00000100:00100000:0.0:1788330399.469728:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99edc7793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ce3fcfa-33df-4730-b19b-df0f5c7a4b47+13:2411:x1875199766179712:12345-192.168.202.50@tcp:400:kworker.0 Request processed in 1140us (7324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330399.469742:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 170 00000100:00100000:2.0:1788330399.469864:0:17103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.50@tcp, seq: 72 00010000:00010000:1.0:1788330400.355597:0:17091:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 43861 lines, 43861 kept, 0 dropped, 0 bad.